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(57) When playing an AV Clip recorded on a BD- 
ROM, a judgment is made, for each elementary stream, 
which of a plurality of predetermined conditions the ele- 
mentary stream satisfies. The plurality of predetermined 
conditions include (a) a condition that a playback appa- 
ratus has a capability of playing the elementary stream, 
(b) a language attribute of the elementary stream match- 
es a language setting of the playback apparatus, and (c) 
a channel attribute of the elementary stream is surround 
sound and the playback apparatus has a surround output 
capability. The playback apparatus assigns a priority to 
each elementary stream based on which conditions the 
elementary stream satisfies, selects an elementary 
stream having a highest priority, and plays the selected 
elementary stream. 
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Description 

Technical Field 

[0001 ] The present invention relates to a playback ap- 
paratus for a recording medium, and in particular relates 
to improvements in a function of selecting one of a plu- 
rality of elementary streams and playing back the select- 
ed elementary stream. 

Background Art 

[0002] In distribution of movie content in recent years, 
the number of streams multiplexed to form one digital 
stream is on the increase. In view of this, the stream 
selection function mentioned above is regarded as par- 
ticularly important. The increase in the numberof streams 
is due to an attempt to support every combination of co- 
dec, channel number, and language attribute. 
[0003] Suppose there are three codecs AC-3 (2ch), 
AC-3 (5.1ch), and DTS (5.1 ch), and two language at- 
tributes Japanese and English. In this case, six audio 
streams corresponding to six combinations of these co- 
decs and language attributes are produced and multi- 
plexed to form one digital stream. These audio streams 
have a specific numbering system. Accordingly, by set- 
ting a stream number of one of the audio streams in a 
status register in a playback apparatus so that the play- 
back apparatus selects the audio stream identified by the 
stream number in the status register, the audio stream 
corresponding to the particular codec-language combi- 
nation can be played at each playback session. 
[0004] The status register used here is initialized upon 
factory shipment, and may be updated later by the user. 
[0005] In the above playback apparatus, the status 
register is unchanged unless the user updates it. This 
being so, once the status register has been set to indi- 
cate, for example, AC-3 (2ch), even when content in- 
cludes an AC-3 (5.1ch) audio stream, the AC-3 (5.1 ch) 
audio stream is not played unless the user updates the 
status register. In this case, the AC-3 (5.1 ch) audio 
stream is wasted. To avoid this, it may be suggested to 
provide the playback apparatus with a function of auto- 
matically setting the status register so as to utilize its AC- 
3 (5.1ch) playback capability. 

[0006] However, not every content contains anAC-3 
(5.1 ch) audio stream. For example, anAC-3 (5.1ch)au- 
diostreamis certainly included in content of a recent hit 
movie, but may not be included in content of an old movie 
or an art film. If the status register automatic setting func- 
tion operates when playing content that does not include 
an AC-3 (5.1 ch) audio stream, the playback apparatus 
will end up selecting a nonexistent audio stream. 
[0007] Conversely, it may be suggested to store, on a 
BD-ROM carrying an AC-3 (5.1ch) audio stream, infor- 
mation for automatically selecting the AC-3 (5. 1 ch) audio 
stream. However, not every playback apparatus has an 
AC-3 (5.1 ch) decoding capability. If the BD-ROM in- 



structs a playback apparatus without the AC-3 (5.1ch) 
decoding capability to select the AC-3 (5.1 ch) audio 
stream, a problem occurs. 

[0008] Thus, since not every content includes an AC- 
5 3 (5. 1 ch) audio stream and not every playback apparatus 
has an AC-3 (5.1 ch) decoding capability, the user needs 
to set the status register in order to select an optimal 
audio stream at each playback session. A failure to do 
so often causes an AC-3 (5.1 ch) audio stream to bewast- 
10 ed without being played back. 

Disclosure of Invention 

[0009] The present invention aims to provide a play- 
15 back apparatus that performs stream selection so as to 
make full use of advantages of both a recording medium 
and the playback apparatus. 

[0010] The stated aim can be achieved by a playback 
apparatus including: a judgment unit operable to judge, 
for each elementary stream, which of a plurality of pre- 
determined conditions the elementary stream satisfies; 
and a playback unit operable to assign a priority to each 
elementary stream according to a pattern of conditions 
the elementary stream satisfies, and select and play back 
a highest-priority elementary stream. 
[0011] Each elementary stream is assigned a priority 
depending on which of the plurality of conditions the el- 
ementary stream satisfies. The plurality of conditions re- 
late to a decoding capability of the playback apparatus, 
a language setting of the playback apparatus, and a sur- 
round output capability of the playback apparatus. If an 
AC-3 (5.1ch) elementary stream included in the digital 
stream satisfies all of these conditions, the AC-3 (5.1 ch) 
elementary stream is assigned a highest priority and se- 
lected for playback. If the playback apparatus does not 
have an AC-3 (5.1ch) playback capability, on the other 
hand, an elementary stream that is decodable by the 
playback apparatus and matches the language setting 
of the playback apparatus is selected for playback. 
[0012] Thus, a priority is assigned to each audio 
stream depending on which conditions the audio stream 
satisfies, and a highest-priority audio stream is selected 
for playback. This is a shift from a conventional idea of 
simply selecting a playable audio stream, to an idea of 
selecting such an audio stream that fully exploits the ca- 
pabilities of the playback apparatus. 

Brief Description of Drawings 



50 [0013] 

FIG. 1 A shows an example of use of a playback ap- 
paratus to which the present invention relates. 
FIG. 1 B shows keys on a remote control 400 for re- 
55 ceiving a user operation on an Interactive Display. 
FIG. 2 shows a structure of a BD-ROM. 
FIG. 3 shows a representation of how an AV Clip is 
formed. 
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FIG. 4 shows a structure of Clip information. 
FIG. 5 shows a structure of PlayList information. 
FIG. 6 shows a representation of indirect referencing 
by PlayList information. 

FIG. 7 shows a representation of synchronization of 5 
a SubPlayltem using a sync_Playltem_id and a 
sy n ch_start_PTS_of_P I ay I te m . 
FIG. 8 shows a structure of an STN_table. 
FIG. 9A shows an entry-attribute combination corre- 
sponding to a video stream. 10 
FIG. 9B shows an entry-attribute combination corre- 
sponding to an audio stream. 
FIG. 9C shows an entry-attribute combination cor- 
responding to a PG stream. 

FIG. 9D shows an entry-attribute combination cor- 15 
responding to textST stream. 

FIG. 9E shows an entry-attribute combination corre- 
sponding to an IG stream. 

FIG. 10 shows a structure of PlayList information 
preloaded on an HD. 20 
FIG. 1 1 shows file designation by Clip_lnformation_ 
file_names in the PlayList information on the HD. 
FIG. 12 shows an internal construction of the play- 
back apparatus to which the present invention re- 
lates. 25 
FIG. 13 shows detailed settings of PSR1 , PSR2, 
PSR15, PSR16, and PSR30. 

FIG. 14 shows detailed settings of PSR4 to PSR8. 

FIG. 1 5A shows status transitions that can be made 

byPSRL 30 

FIG. 15B is a flowchart of "Procedure when playback 

condition is changed" for PSR1 . 

FIG. 1 6 is a flowchart of a detailed procedure of step 

S5. 

FIG. 1 7 shows combinations of playback capabilities 35 

and stream attributes in a tabular form. 

FIG. 18 shows audio stream selection based on an 

order of entries in an STN_table. 

FIG. 1 9 is a flowchart of "Procedure when change is 

requested" for PSR1. *o 

FIGS. 20A to 20C show a first specific example of 

audio stream selection according to "Procedure 

when playback condition is changed". 

FIGS. 21 A to 21C show a second specific example 

of audio stream selection according to "Procedure 45 

when playback condition is changed". 

FIGS. 22A to 22C show a third specific example of 

audio stream selection according to "Procedure 

when playback condition is changed". 

FIG. 23A shows status transitions that can be made 50 

by PSR2. 

FIG. 23B is a flowchart of "Procedure when playback 
condition is changed" for PSR2. 
FIG. 24 is a flowchart of "Procedure when change is 
requested" for PSR2. 55 
FIG. 25 is a flowchart of an operation of setting PSR2. 
FIGS. 26A to 26C show a specific example of PG_ 
textST_stream selection according to "Procedure 



when playback condition is changed". 
FIG. 27 shows PG_textST_stream selection based 
on an order of entries in an STN_table. 
FIG. 28 shows a structure of PlayList information in 
a second embodiment of the present invention. 
FIG. 29 shows a file structure in the second embod- 
iment. 

FIGS. 30A and 30B show multi-angle and non-multi- 
angle blocks. 

FIG. 31 shows detailed settings of PSR3. 

FIG. 32A shows status transitions that can be made 

by PSR3. 

FIG. 32B is a flowchart of "Procedure when playback 
condition is changed" for PSR3. 
FIG. 32C is a flowchart of "Procedure when change 
is requested" for PSR3. 

FIGS. 33A and 33B show how angle blocks are se- 
lected. 

FIG. 34 shows an IG stream and an ICS in the IG 
stream. 

FIG. 35 shows a structure of button_info. 

FIG. 36 show a relationship between an ICS and 

ODSs in DSn. 

FIG. 37 shows overlaying performed with a presen- 
tation timing of picture data pt1. 
FIG. 38 shows status transitions of Buttons 1 -A to 1 - 
D. 

FIG. 39 shows an example of settings of button_info 
in an ICS. 

FIG. 40 shows display switching from Page 1 to Page 
2. 

FIG. 41 shows detailed settings of PSRO, PSR10, 
and PSR11. 

FIG. 42A shows status transitions that can be made 
by PSRO. 

FIG. 42B is a flowchart of "Procedure when playback 
condition is changed" for PSRO. 
FIG. 43 is a flowchart of "Procedure when change is 
requested" for PSRO. 

FIG. 44 shows an internal structure of an Interactive 
Graphics Decoder 13. 

FIG. 45 is a flowchart of a synchronous control pro- 
cedure using time stamps. 

FIG. 46 is a flowchart of an initial display procedure. 
FIG. 47 is a flowchart of an auto-activation proce- 
dure. 

FIG. 48 is a flowchart of an animation display proce- 
dure. 

FIG. 49 is a flowchart of a button command execution 
procedure. 

FIG. 50 is a flowchart of an UO procedure. 

FIG. 51 is a flowchart of a current button switching 

procedure. 

FIG. 52 shows key operations performed by the user 

when viewing a drama series. 

FIG. 53 shows how Pages 1 to 4 shown in FIG. 52 

are assigned to a selection menu and a chapter 

menu. 
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FIG. 54 shows procedures defined by button com- 
mands to achieve focus shifts. 
FIG. 55 shows focus shifts performed according to 
focus positions on previous Pages. 
FIG. 56 shows bugs that can occur in focus shifts. 
FIG. 57A shows status transitions that can be made 
by PSR11. 

FIG. 57B is a flowchart of "Procedure when playback 
condition is changed" for PSR1 1 . 
FIG. 57C is a flowchart of "Procedure when change 
is requested" for PSR1 1 . 

FIG. 58A shows status transitions that can be made 
by PSR10. 

FIG. 58B is a flowchart of "Procedure when playback 
condition is changed" for PSR10. 
FIG. 59 is a flowchart of "Procedure when change is 
requested" for PSR10. 

Best Mode for Carrying out the Invention 

First Embodiment 

[001 4] The following describes embodiments of a play- 
back apparatus to which the present invention relates. 
First, an example of an act of using the playback appa- 
ratus according to the present invention is explained. 
FIG. 1 shows an example of use of the playback appa- 
ratus according to the present invention. In the drawing, 
the playback apparatus according to the present inven- 
tion is a playback apparatus 200, which constitutes a 
home theater system together with a television 300 and 
a remote control 400. 

[0015] A BD-ROM 100 is used for providing a movie 
film in the home theater system that is constituted by the 
playback apparatus 200, the television 300, and the re- 
mote control 400. 

[001 6] The remote control 400 receives a user opera- 
tion directed to the playback apparatus 200. FIG. 1B 
shows keys on the remote control 400 for receiving a 
user operation on an Interactive Display. As illustrated, 
the remote control 400 has a Move Up key, a Move Down 
key, a Move Right key, a Move Left key, an audio switch 
key for receiving an audio switching operation, a subtitle 
switch key for receiving a subtitle switching operation, 
and numeric keys "0" to "9". 

[001 7] This concludes the description of the act of us- 
ing the playback apparatus according to the present in- 
vention. 

[0018] The BD-ROM which is a recording medium to 
be played back by the playback apparatus according to 
the present invention is described next. FIG. 2 shows a 
structure of the BD-ROM. In the drawing, the fourth level 
shows the BD-ROM, and the third level shows a track on 
the BD-ROM. The track is shown as being stretched out 
into a straight line, though in actuality the track spirals 
outwards from the center of the BD-ROM. The track in- 
cludes a lead-in area, a volume area, and a lead-out area. 
The volume area has a layer model of a physical layer, 



a file system layer, and an application layer. The first 
level shows a format of the application layer (application 
format) of the BD-ROM in a directory structure. As illus- 
trated, the BD-ROM has a BDMV directory below a 
5 ROOT directory. The BDMV directory contains files such 
as YYY.MPLS, XXX.CLPI, XXX.M2TS, ZZZ.M2TS, and 
ZZZ.CLPI. The XXX.M2TS file corresponds to an AV 
Clip, and the XXX.CLPI file corresponds to Clip informa- 
tion. 

10 [0019] The recording medium according to the present 
invention can be realized by generating such an applica- 
tion format. 

<Structure of the AV Clip> 

15 

[0020] The AV Clip which is one of the components 
(AV Clip and Clip information) of content of the movie 
film is described below. 

[0021] FIG. 3 shows a representation of how the AV 

20 Clip is formed. 

[0022] The AV Clip (middle level) can be created as 
follows. A video stream made up of a plurality of video 
frames (pictures pj1, pj2, pj 3, ...) and an audio stream 
made up of a plurality of audio frames (upper first level) 

25 are each converted to PES packets (upper second level), 
and further converted to TS packets (upper third level). 
Likewise, a Presentation graphics stream (PG stream) 
for subtitles and an Interactive graphic stream (IG 
stream) for Interactive Displays (lower first level) are con- 

30 verted to PES packets (lower second level), and further 
converted to TS packets (lower third level) . These TS 
packets of the video, audio, and PG and IG streams are 
then multiplexed to form the AV Clip. 
[0023] Here, not only the PG stream multiplexed in the 

35 AV Clip but also a textST stream forms subtitles. The 
textST stream is a data string that represents subtitles 
by text data. The textST stream is called a subClip, and 
is recorded on the BD-ROM or an HD in the playback 
apparatus by a filename different from that of the AV Clip. 

40 The PG stream and the textST stream which form sub- 
titles are both called a PG_textST_stream. This con- 
cludes the description of the AV Clip. 

<Structure of the Clip lnformation> 

45 

[0024] The following describes the XXX.CLPI file. 
[0025] The Clip information (XXX.CLPI) is manage- 
ment information for the individual AV Clip. FIG. 4 shows 
a structure of the Clip information. Dotted guidelines in 
50 the drawing indicate the structure of the Clip information 
in more detail. As indicated by guideline hn1, the Clip 
information (XXX.CLPI) includes Program. Info and an 
EP_map used for searching the video stream for a start 
of an I picture. 

55 [0026] The Program. Info is information showing a PI D 
and an attribute of each individual elementary stream 
multiplexed in the AV Clip, in association with a Stream_ 
index. The Stream_index is an index of each individual 
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elementary stream multiplexed in the AV Clip corre- 
sponding to this Clip information. PIDs of the individual 
elementary streams identified by Stream_indices are 
shown in Stream_PID [Stream_index] entries indicated 
by guideline hn2. 

[0027] Also, attributes of the individual elementary 
streams identified by the Stream_indices are shown in 
Stream_Attribute [Stream_index] entries indicated by 
guideline hn3. The attributes include video attributes, au- 
dio attributes, and graphics attributes. The video at- 
tributes show a method used for compressing a video 
stream (Coding), a resolution of picture data which com- 
poses the video stream (Resolution), an aspect ratio of 
the picture data (Aspect), a frame rate of the picture data 
(Framerate), and the like. The audio attributes show a 
method used for compressing an audio stream (Coding), 
a channel attribute of the audio stream (Ch.), a language 
attribute of the audio stream (Lang), and the like. Through 
the use of a stream_index, an attribute of an elementary 
stream can be retrieved from the Program. Info. 
[0028] The EP_map is a reference table for indirect 
referencing of addresses of a plurality of locations to 
which a skip operation is likely to be made, using time 
information. As indicated by guideline hn5, the EP_map 
includes a plurality of entries (ACCESS UNIT #1 entry, 
ACCESS UNIT #2 entry, ACCESS UNIT #3 entry, ...) 
and the number of entries (Number). 
[0029] As indicated by guideline hn6, each of the en- 
tries shows a playback start time of a corresponding I 
picture, together with an address of the I picture and a 
size of the I picture (l-Size). The playback start time of 
the I picture is expressed using a time stamp (Presenta- 
tion Time Stamp) of the I picture. The address of the I 
picture is expressed using a serial number (SPN (Source 
Packet Number)) of a TS packet corresponding to the I 
picture. It should be noted here that the filename XXX of 
the Clip information XXX. CLPI is the same as the filena- 
me of the AV Clip corresponding to the Clip information. 
Which is to say, the filename XXX of the Clip information 
in FIG. 4 means the Clip information corresponds to the 
AV Clip XXX.M2TS. This concludes the description of 
the Clip information. 

<ZZZ.M2TS and ZZZ.CLPI> 

[0030] The following describes the ZZZ.M2TS file and 
the ZZZ.CLPI file. The subClip (ZZZ.M2TS) is a file stor- 
ing a stream that is played synchronously with the AV 
Clip. A representative of such a subClip is the aforemen- 
tioned textST stream. Other subClips include an audio 
stream and an IG stream. The AV Clip shown in FIG. 3 
is hereafter also called a main Clip, to distinguish it from 
the subClip. 

[0031] The Clip information (ZZZ.CLPI) is Clip infor- 
mation corresponding to the subClip. 



<Structure of the PlayList information> 

[0032] The following describes the YYY.MPLS file. 
The PlayList information (YYY.MPLS) is information 

5 which defines a combination of two types of playback 
paths that are a main path and a SubPath, as a PlayList 
(PL) . FIG. 5 shows a data structure of the PlayList infor- 
mation. As shown in the drawing, the PlayList information 
includes Playltem information #1 , #2, ... , #m for defining 

10 the main path and SubPath information #1, #2, ... , #p 
each for defining the SubPath. 

[0033] The main path is a playback path defined on an 
AV Clip which is the main Clip, whereas the SubPath is 
a playback path defined on a subClip. 

15 [0034] The main path is explained first. The main path 
is defined by a plurality of sets of Playltem information 
(Playltem information #1 , #2, #3, ... , #m) and the number 
of sets of Playltem information (Number). Playltem infor- 
mation defines at least one logical playback section in- 

20 eluded in the main path. Guideline hs1 indicates a de- 
tailed structure of the Playltem information. As illustrated, 
the Playltem information includes a Clip_lnformation_ 
file_name field showing a filename of Clip information of 
the AV Clip to which an IN point and an OUT point of the 

25 playback section belong, a Clip_codec_identifier field 
showing a coding method of the AV Clip, an IN_time field 
which is time information indicating a start of the playback 
section, an OUT_time field which is time information in- 
dicating an end of the playback section, and an STN_ 

30 table field showing, among the elementary streams in 
the AV Clip and its related subClip, elementary streams 
from which the playback apparatus can select for pres- 
entation of the Playltem. 

[0035] The Playltem information has a feature of being 

35 written based on conversion from time information to an 
addresses. In other words, the playback section is de- 
fined in the form of indirect referencing that uses the EP_ 
map as a reference table. FIG. 6 shows a representation 
of indirect referencing by PlayList information. In the 

40 drawing, the AV Clip is composed of a plurality of TS 
packets. The EP_map in the Clip information specifies 
sector addresses of TS packets that correspond to starts 
of I pictures, as indicated by arrows ay 1 , ay2, ay3, ay4, .... 
Arrows jy1, jy2, y3, jy4, ... indicate a representation of 

45 referencing of TS packets by Playltem information. It can 
be understood from the drawing that the referencing by 
the Playltem information (indicated by arrows jy1, jy2, 
jy3, jy4, ...) is indirect referencing that specifies address- 
es of TS packets in the AV Clip through the EP_map. 

50 [0036] A playback section on the BD-ROM, which is 
obtained by a combination of Playltem information, Clip 
information, and an AV Clip, is called a Playltem. The 
movie film recorded on the B D-ROM is composed of Play- 
Items. Since the movie film recorded on the BD-ROM is 

55 composed of logical playback units, "sharing", i.e. an AV 
Clip which forms a scene of one movie film being refer- 
enced by another movie film, can be efficiently conduct- 
ed. 



5 



9 



EP 1 921 622 A2 



10 



[0037] The variation in movie films can be widened just 
by defining various kinds of PlayList information, which 
enables movie film producers to extend the range of ex- 
pression. This is a greatest advantage of static scenario. 
Playback units of BD-ROMs include not only a Playltem 
but also a Title and a Chapter. The Title is a playback 
unit corresponding to one movie film, and is composed 
of at least one set of PlayList information. The Chapter 
is a playback unit corresponding to one chapter of a mov- 
ie film, and is defined by information called Mark infor- 
mation. 

[0038] The filename YYY of the PlayList information 
represents a three-digit ID number assigned to the Play- 
List information in the BD-ROM. Which is to say, the Play- 
List information shown in FIG. 6 is uniquely identified by 
this ID number YYY. The use of "YYY" as the ID number 
of the PlayList information indicates that the ID number 
of the PlayList information has a different numbering sys- 
tem from the ID number XXX of the AV Clip and the Clip 
information (though the number of digits of the ID number 
is three in this example, the number of digits is not limited 
to such). 

[0039] This concludes the description of the main path. 
The SubPath is described next. 

<SubPath> 

[0040] Guideline hc1 in FIG. 5 indicates a structure of 
SubPath information in detail. As illustrated, the SubPath 
information is made up of at least one set of SubPlayltem 
information. SubPlayltem information includes a Clip_ 
lnformation_file_name field, a Clip_codec_identifier 
field, a SubPlayltem_IN_time field, a SubPlayltem_ 
OUTJime field, a sync_Playltem_id field, and a sync_ 
start_PTS_of_P lay Item field, as indicated by guideline 
hc2. 

[0041] The Clip_lnformation_file_name field shows a 
filename of Clip information of a subClip corresponding 
to the SubPlayltem, to thereby uniquely identify the sub- 
Clip. 

[0042] The Clip_codec_identifier field shows a coding 
method of the subClip. 

[0043] The SubPlayltem_IN_time field is time informa- 
tion indicating a start of the SubPlayltem on a playback 
time axis of the subClip. 

[0044] The Sub Play ltem_OUT_time field is time infor- 
mation indicating an end of the SubPlayltem on the play- 
back time axis of the subClip. 

[0045] The sync_Playltem_id field uniquely identifies 
one of the Playltems in the main path with which the 
SubPlayltem is to be synchronized. The SubPlayltem_ 
IN_time is present on a playback time axis of the Playltem 
identified by the sync_Piayltem_id. 
[0046] The sync_start_PTS_of_P lay Item field speci- 
fies the start of the SubPlayltem indicated by the 
SubPlayltem_IN_time, on the playback time axis of the 
Playltem identified by the sync_Playltem_id. When the 
current playback time has reached a point specified by 



this sync_start_PTS_of_Playltem on the playback time 
axis of the Playltem, the playback of the SubPlayltem is 
launched. 

[0047] FIG. 7 shows a representation of synchroniza- 

5 tion of the SubPlayltem according to the sync_Playltem_ 
id and the sync_start_PTS_of_Playltem. In the drawing, 
the main path is made up of Playltems #1, #2, and #3. 
The sync_Playltem_id and the sync_start_PTS_of_ 
Playltem of the SubPlayltem which forms a SubPath are 

10 set as shown in dotted box wh1. In detail, the sync_ 
Playltem_id is set to specify Playltem #1 , and the sync_ 
start_PTS_of_Playltem is set to specify time t1 on the 
playback time axis of Playltem #1 . This being the case, 
when the current playback time has reached t1 on the 

15 playback time axis of Playltem #1 , playback of a part of 

the subClip (textST stream), specified by the Clip 

lnformation_file name, from the SubPlayltem_IN_time 

to the SubPlayltem_OUT_time is launched. As a result, 
the part of the textST stream from the SubPlayltem_IN_ 

20 time to theSubPlayltem_OUT_time is played synchro- 
nously with the AV Clip. This concludes the description 
of the SubPath information. 

[0048] The STN_table field included in the Playltem 
information described above provides information used 
25 for status settings, and is an essential feature of the 
present invention. The following describes the STN_ta- 
ble in detail. 

<STN_table> 

30 

[0049] The STN_table shows elementary streams 
available for presentation, among elementary streams 

multiplexed in the AV Clip specified by the Clip 

I nf o rm at io n_f i I e_n am e of the Playltem and elementary 

35 streams in a subClip specified by the Clip_lnformation_ 
file_name of a SubPlayltem relating to the Playltem. The 
STN_table is formed by associating an entry of each el- 
ementary stream with its attribute. An elementary stream 
available for presentation is mainly an elementary stream 

40 multiplexed in the AV Clip specified by the Playltem, but 
may also include an elementary stream (textST stream) 
recorded separately from the AV Clip but played together 
with the AV Clip. 

[0050] FIG. 8 shows a structure of the STN_table. As 
45 shown in the drawing, the STN_table includes a plurality 
of combinations of entries and attributes (entry-attribute), 
and the numbers of entry-attribute combinations 
(number_of_video_stream_entries, number_of_audio_ 
stream_entries, number_of_PG_textST_stream_en- 
50 tries, and number_of_IG_stream_entries) 

[0051 ] The entry-attribute combinations correspond to 
a video stream, audio streams, PG_textST_str earns, and 
IG streams that are available for presentation in the Play- 
ltem, as indicated by the parenthesis "{". 
55 [0052] The entry-attribute combinations are explained 
in detail below. FIGS. 9A to 9D show the entry-attribute 
combinations in detail. 

[0053] FIG. 9A shows an entry-attribute combination 
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corresponding to a video stream. 

[0054] An entry in this entry-attribute combination cor- 
responding to the video stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the video stream when demultiplexing the AV 
Clip. 

[0055] An attribute in the entry-attribute combination 
corresponding to the video stream includes a stream_ 
coding_type field which is set to 0x02, and a frame_rate 
field showing a display rate of the video stream. 
[0056] FIG. 9B shows an entry-attribute combination 
corresponding to an audio stream. 
[0057] An entry in the entry-attribute combination cor- 
responding to the audio stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the audio stream when demultiplexing the AV 
Clip. 

[0058] An attribute in the entry-attribute combination 
corresponding to the audio stream includes a stream_ 
coding_type field which is set to one of 0x80 (Linear 
PCM), 0x81 (AC-3), and 0x82 (DTS) to indicate a coding 
type of the audio stream, an audio_presentation_type 
field showing a channel structure of the audio stream and 
indicating whether surround output is possible, and an 
audio_language_code field showing a language attribute 
of the audio stream. 

[0059] FIG. 9C shows an entry-attribute combination 
corresponding to a PG stream. 

[0060] An entry in the entry-attribute combination cor- 
responding to the PG stream includes a ref_to_stream_ 
PID_of_mainClip field showing a PID used for extracting 
the PG stream when demultiplexing the AV Clip. 
[0061] An attribute in the entry-attribute combination 
corresponding to the PG stream includes a stream_ 
coding_type field which is set to 0x90 indicating a PG 
stream codec, and a PG_anguage_code field showing a 
language attribute of the PG stream. 
[0062] FIG. 9D shows an entry-attribute combination 
corresponding to a textST stream. 
[0063] An entry in the entry-attribute combination cor- 
responding to the textST stream includes a ref_to_ 
subClip_entry_id field showing an entry identifier of a 
subClip storing the textST stream, a ref_to_SubPath_id 
field showing an ID of SubPath information, and a ref_ 
to_stream_PID_of_subClip field showing a PID of the 
textST stream. 

[0064] An attribute in the entry-attribute combination 
corresponding to the textST stream includes a stream_ 
coding_type field which is set to 0x92 indicating a textST 
stream codec, a character_code field showing a charac- 
ter code of the textST stream, and a textST_language_ 
code field showing a language attribute of the textST 
stream. 

[0065] FIG. 9E shows an entry-attribute combination 
corresponding to an IG stream. 

[0066] An entry in the entry-attribute combination cor- 
responding to the IG stream includes a ref_to_stream_ 
PID_of_mainClip field showing a PID used for extracting 



the IG stream when demultiplexing the AV Clip. 
[0067] An attribute in the entry-attribute combination 
corresponding to the IG stream includes a stream_ 
coding_type field which is set to 0x91 indicating an IG 

5 stream codec, and an IG_language_code field showing 
a language attribute of the IG stream. This concludes the 
description of the data structure of the entry-attribute 
combination of each elementary stream. The order of 
entries in the STN_table is interpreted as the order of 

10 priorities in stream selection. Also, entries of textST 
streams and PG streams are put in one group in the STN_ 
table in order to treat the PG streams and the textST 
streams on an equal basis and determine which stream 
out of the PG streams and the textST streams has a 

15 higher priority. For example, if a textST stream has a 
higher entry than a PG stream in the group of entries for 
PG_textST_streams intheSTN_table, the textST stream 
is selected over the PG stream. Conversely, if the PG 
stream has a higher entry than the textST stream in the 

20 STN_table, the PG stream is selected over the textST 
stream. 

[0068] The above STN_table is provided for each set 
of PlayList information. Therefore, there may be a case 
where an entry of one elementary stream is high in an 

25 STN_table of one set of PlayList information but low in 
an STN_table of another set of PlayList information. 
[0069] This concludes the description of the data struc- 
ture of the application format in the BD-ROM. It should 
be noted here that the recording medium to be played 

30 back by the playback apparatus according to the present 
invention is not limited to the BD-ROM, but also includes 
the HD in the playback apparatus. Data recorded on the 
HD is explained below. The HD stores a file containing 
a subClip, a file containing Clip information, and a file 

35 containing PlayList information, too. These files are 
preloaded onto the HD via a network. FIG. 10 shows a 
structure of such preloaded PlayList information. As 
shown in the drawing, the preloaded PlayList information 
has a similar structure to the PlayList information on the 

40 BD-ROM shown in FIG. 5. The difference from the one 
shown in FIG. 5 lies in that a Clip_lnformation_file_name 
in Playltem information and a Clip_lnformation_file_ 
name in SubPlayltem information can each designate 
Clip information on any of the BD-ROM and the HD. To 

45 designate Clip information on the BD-ROM, a full path of 
a file on the BD-ROM needs not be used in the preloaded 
PlayList information. This is because the playback appa- 
ratus recognizes the BD-ROM and the HD together as 
one virtual drive (called a virtual package). Accordingly, 

50 a Clip_lnformation_file_name in Playltem information 
and a Clip_lnformation_file_name in SubPlayltem infor- 
mation in the preloaded PlayList information can desig- 
nate an AV Clip on any of the HD and BD-ROM, by using 
a file body, such as XXX or ZZZ, of a file containing Clip 

55 information. FIG. 1 1 shows designation of files by Clip_ 
lnformation_file_names in PlayList information on the 
HD. In the drawing, arrows rf1, rf2, and rf3 indicate file 
designation by Clip_lnformation_file_names in Playltem 
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information in the PlayList information, and arrows pf 1 , 
pf2, andpf3 indicate file designation by Clip_lnformation_ 
file_names in SubPlayltem information in the PlayList in- 
formation. Through such file designation by Clip_ 
lnformation_file_names, a SubPath defined on a subClip 
on the HD can be played synchronously with a main path 
defined on a main Clip on the BD-ROM. 
[0070] Note that the data structures explained above 
are instances of class structures written in a program- 
ming language. The author writes the class structures to 
create these data structures on the BD-ROM. 
[0071 ] This concludes the description of the recording 
medium. The following describes the playback apparatus 
according to the present invention. FIG. 12 shows an 
internal construction of the playback apparatus accord- 
ing to the present invention. The playback apparatus ac- 
cording to the present invention is manufactured based 
on this internal construction. The playback apparatus is 
roughly made up of two parts that are a system LSI and 
a drive device. The playback apparatus can be manu- 
factured by mounting these parts on a cabinet and sub- 
strate of the apparatus. The system LSI is an integrated 
circuit including various processing units for achieving 
the functions of the playback apparatus. The playback 
apparatus includes a BD drive 1 , a Read Buffer 2, a De- 
multiplexer 3, a Video Decoder 4, a Video Plane 5, a 
Presentation Graphics Decoder 9, a Presentation Graph- 
ics Plane 10, an adder 11, a Font Generator 12, an In- 
teractive Graphics Decoder 13, a switch 14, an Interac- 
tive Graphics Plane 1 5, an adder 1 6, an HDD 1 7, a Read 
Buffer 18, a Demultiplexer 19, an Audio Decoder 20, a 
scenario memory 23, a control unit 24, a switch 25, a 
CLUT unit 26, a CLUT unit 27, a PSR set 28, and an 
operation reception unit 29. The control unit 24 includes 
a transition control unit 30. 

[0072] The BD drive 1 performs loading and ejecting 
of the BD-ROM, and accesses to the BD-ROM. 
[0073] The Read Buffer 2 is a FIFO memory. Accord- 
ingly, TS packets read from the BD-ROM are removed 
from the Read Buffer 2 in a same order as they arrive. 
[0074] The Demultiplexer (Demux) 3 reads TS packets 
from the Read Buffer 2 and converts the TS packets to 
PES packets. The Demultiplexers outputs PES packets 
having a stream ID designated by the control unit 24 to 
one of the Video Decoder 4, the Audio Decoder 20, the 
Presentation Graphics Decoder 9, and the Interactive 
Graphics Decoder 13. 

[0075] The Video Decoder 4 decodes PES packets 
output from the Demultiplexer 3 to obtain uncompressed 
pictures, and writes the uncompressed pictures to the 
Video Plane 5. 

[0076] The Video Plane 5 is a plane for storing uncom- 
pressed pictures. Here, a plane is a memory area used 
for storing one screen of pixel data in the playback ap- 
paratus. By providing the playback apparatus with a plu- 
rality of planes and adding the storage contents of these 
planes for corresponding pixels, an imageoutput in which 
a plurality of images are overlaid on each other can be 



produced. The Video Plane 5 has a resolution of 1920 
x 1 080, and picture data stored on the Video Plane 5 is 
composed of pixel data expressed by 1 6-bit YU V values. 
[0077] The Presentation Graphics Decoder 9 decodes 
5 a graphics stream read from the 3D-ROM or the HD to 
obtain uncompressed graphics, and writes the uncom- 
pressed graphics to the Presentation Graphics Plane 1 0. 
As a result of decoding the graphics stream, subtitles are 
displayed on the screen. 

[0078] The Presentation Graphics Plane 1 0 is a mem- 
ory having one screen of area, and is capable of storing 
one screen of uncompressed graphics. The Presentation 
Graphics Plane 1 0 has a resolution of 1 920 x 1 080, and 
each pixel in the uncompressed graphics on the Presen- 
tation Graphics Plane 10 is expressed by an 8-bit index 
color. By converting the index color using a CLUT (Color 
Lookup Table), the uncompressed graphics on the Pres- 
entation Graphics Plane 10 is presented for display. 
[0079] The adder 1 1 overlays the storage contents of 
the Presentation Graphics Plane 10 on uncompressed 
picture data (i). 

[0080] The Font Generator 12 develops text code in- 
cluded in a textST stream to a bitmap, using a character 
font. 

[0081] The Interactive Graphics Decoder 13 decodes 
an IG stream read from the BD-ROM or the HD to obtain 
uncompressed graphics, and writes the uncompressed 
graphics to the Interactive Graphics Plane 15. 
[0082] The switch 14 selectively writes one of a font 
string generated by the Font Generator 12 and graphics 
generated by the Presentation Graphics Decoder 9, to 
the Presentation Graphics Plane 10. 
[0083] The Interactive Graphics Plane 15 is used for 
storing uncompressed graphics obtained by the Interac- 
tive Graphics Decoder 13. 

[0084] The adder 1 6 overlays the storage contents of 
the Interactive Graphics Plane 15, on picture data (ii) 
which is generated by overlaying the storage contents of 
the Presentation Graphics Plane 10 on the uncom- 
pressed picture data (i). 

[0085] The H DD 1 7 is the aforementioned HD included 
in the playback apparatus. By reading the storage con- 
tents of the HDD 17 and dynamically combining them 
with the storage contents of the BD-ROM, a graphics 
stream or a textST stream not recorded on the BD-ROM 
can be presented. 

[0086] The Read Buffer 1 8 is a FIFO memory. Accord- 
ingly, TS packets read from the HDD 17 are removed 
from the Read Buffer 1 8 in the same order as they arrive. 
[0087] The Demultiplexer (Demux) 19 reads TS pack- 
ets from the Read Buffer 1 8 and converts the TS packets 
to PES packets. The Demultiplexer 1 9 outputs PES pack- 
ets having a stream ID designated by the control unit 24, 
to the Font Generator 12. 

[0088] The Audio Decoder 20 decodes PES packets 
output from the Demultiplexer 3, and outputs uncom- 
pressed audio data. 

[0089] The scenario memory 23 is used for storing cur- 
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rent PlayList information and current Clip information. 
The current PlayList information refers to PlayList infor- 
mation that relates to the current playback, among a plu- 
rality of sets of PlayList information recorded on the BD- 
ROM. The current Clip information refers to Clip informa- 
tion that relates to the current playback, among a plurality 
of sets of Clip information recorded on the BD-ROM. 
[0090] The control unit 24 controls reading of an AV 
Clip from the BD-ROM and playback of the AV Clip, ac- 
cording to the current PlayList information and the current 
Clip information on the scenario memory 23. In detail, 
the control unit 24 detects the current Playltem in the 
current PlayList information. With reference to the current 
Clip information identified by a Clip_lnformation_file_ 
name of the current Playltem, the control unit 24 controls 
the BD-ROM drive 1 to read TS packets from an IN_time 
to an OUTJime of the current Playltem, from an AV Clip 
specified by the current Clip information. The read TS 
packets are output selectively to the Video Decoder 4, 
the Presentation Graphics Decoder 9, the Interactive 
Graphics Decoder 1 3, and the Audio Decoder 20 via the 
Demultiplexer 3, to play the AV Clip. 
[0091] If the current PlayList information includes a 
SubPlayltem to be synchronized with the current Play- 
ltem, the control unit 24 plays a subClip specified by the 
SubPlayltem synchronously with the main Clip. This syn- 
chronization is conducted by playing back data from a 
SubPlayltem_IN_time to a SubPlayltem_OUT_time of 
the SubPlayltem when picture data corresponding to a 
sync_start_PTS_of_Playltem of the SubPlayltem is read 
from the main Clip. 

[0092] The switch 25 selectively feeds various data 
read from the BD-ROM and the HD to the Read Buffer 
2, the Read Buffer 1 8, and the scenario memory 23. 
[0093] The CLUT unit 26 converts index colors of the 
uncompressed graphics stored on the Video Plane 5, to 
Y, Cr, and Cb values. 

[0094] The CLUT unit 27 converts index colors of the 
uncompressed graphics stored on the Interactive Graph- 
ics Plane 15, to Y, Cr, and Cb values. 
[0095] The PSR set 28 is a register equipped in the 
playback apparatus, and is composed of 64 Player Status 
Registers (PSRs) and 4096 General Purpose Registers 
(GPRs). A definition of a value of each PSR will be ex- 
plained in detail later. 

[0096] The operation reception unit 29 outputs, when 
an operation of selecting a stream or the like is made on 
the remote control or a front panel of the playback appa- 
ratus, user operation information indicating the operation 
to the control unit 24. 

[0097] The transition control unit 30 is included in the 
control unit 24. The transition control unit 30 extracts a 
stream_PID of an entry-attribute combination corre- 
sponding to a PSR from an STN_table in the current Play- 
ltem information, and outputs the extracted stream_PID 
to the Demultiplexer 3 or 19. Since the setting of the 
Stream_PID in the Demultiplexer 3 or 1 9 is based on the 
PSR, the transition control unit 30 performs a setting op- 



eration on the PSR in accordance with a condition change 
in or a change request to the playback apparatus. 
[0098] In detail, when a condition change occurs in the 
playback apparatus, the transition control unit 30 judges 
5 whether a valueof the PSR is Valid, Invalid, or undefined. 
If the value is Valid, the transition control unit30 maintains 
the value. If the value is I nvalid or undefined, the transition 
control unit 30 sets an optimal value in the PSR. 
[0099] When a change of the PSR is requested by user 
10 operation information output from the operation reception 
unit 29 or a button command output from the Interactive 
Graphics Decoder 13, the transition control unit 30 de- 
termines a value (value X) to be set in the PSR according 
to the user operation information or the button command, 
and performs a PSR update operation based on value 
X. If the user operation information indicates that the au- 
dio switch key or the subtitle switch keyhasbeen pressed, 
the transition control unit 30 determines a sum of the 
PSR and 1 as value X. If the user operation information 
indicates that one of the numeric keys has been pressed, 
the transition control unit 30 determines a number cor- 
responding to the pressed numeric key as value X. If the 
button command instructs to set the PSR, on the other 
hand, the transition control unit 30 determines a value 
specified by an argument of the button command as value 
X. Once value X has been determined in this way, the 
transition control unit 30 judges whether value X is Valid, 
Invalid, or undefined, and performs a PSR update oper- 
ation depending on a result of the judgment. In detail, if 
value X is Valid, the transition control unit 30 overwrites 
the PSR with value X. If value X is undefined, the transi- 
tion control unit 30 selects an optimal value and sets the 
optimal value in the PSR. If value X is Invalid, the tran- 
sition control unit 30 maintains the value of the PSR. 

<PSRs> 

[01 00] This concludes the description of the construc- 
tion of the playback apparatus according to the present 
invention. The following describes individual PSRs in the 
PSR set 28. In the PSR set 28, PSR1, PSR2, PSR15, 
PSR1 6, and PSR30 relate to selection of audio and sub- 
titles, capabilities of decoding and presenting audio and 
subtitles, and a language setting in the playback appa- 
ratus. FIG. 13 shows detailed settings of PSR1, PSR2, 
PSR15, PSR16, and PSR30. 

[0101] PSR1 specifies an audio stream currently se- 
lected by the playback apparatus. 
[0102] PSR2 includes a disp_flag field, and specifies 
a PG_textST_stream currently selected by the playback 
apparatus. The disp_flag field is set to 0 to indicate that 
display of a PG stream and a textST stream is disabled, 
and 1 to indicate that display of a PG stream and a textST 
stream is enabled. 

[0103] PSR15 includes an LPCM capability field, an 
AC-3 capability field, and a DTS capability field. The 
LPCM capability field is set to 0001 b to indicate that the 
playback apparatus is capable of playing LPCM stereo, 
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and 001 0 b to indicate that the playback apparatus is ca- 
pable of playing LPCM surround. 

[0104] The AC-3 capability field is set to 0001 b to in- 
dicate that the playback apparatus is capable of playing 
AC-3 stereo, and 001 0 b to indicate that the playback ap- 
paratus is capable of playing AC-3 surround. 
[0105] The DTS capability field is set to 0001 b to indi- 
cate that the playback apparatus is capable of playing 
DTS stereo, 001 0 b to indicate that the playback appara- 
tus is capable of playing DTS surround, and 0000 b to 
indicate that the playback apparatus is incapable of de- 
coding a DTS audio stream. 

[0106] PSR16 is set to a value other than OxFFFF to 
indicate an audio stream language attribute, and set to 
OxFFFF to indicate that no audio stream language at- 
tribute is specified. 

[0107] A most significant bit of PSR30 is set to 0 to 
indicate that the playback apparatus is incapable of dis- 
playing text subtitles, and set to 1 to indicate that the 
playback apparatus is capable of displaying text subtitles. 
[0108] This concludes the explanation of FIG. 13. The 
following describes PSR4 to PSR8 with reference to FIG. 
14. FIG. 14 shows detailed settings of PSR4 to PSR8. 
[0109] PSR4 is set to one of the values 1 to 100 to 
indicate a number of a Title corresponding to the current 
playback time, and set to 0 to indicate that the current 
playback time corresponds to a top menu. 
[0110] PSR5 is set to one of the values 1 to 999 to 
indicate a number of a Chapter corresponding to the cur- 
rent playback time, and set to OxFFFF to indicate that a 
Chapter number is invalid in the playback apparatus. 
[0111] PSR6 is set to one of the values 0 to 999 to 
indicate a number of a PlayList corresponding to the cur- 
rent playback time (current PlayList). 
[0112] PSR7 is set to one of the values 0 to 255 to 
indicate a number of a Playltem corresponding to the 
current playback time (current Playltem). 
[0113] PSR8 is set to one of the values 0 to Ox- 
FFFFFFFF to indicate the current playback time with a 
time accuracy of 45 KHz (current PTM). This concludes 
the explanation of PSR4 to PSR8. 

<Status transitions of PSR1> 

[0114] The following describes status transitions of 
PSR1 in detail. 

[0115] PSR1 specifies one of a plurality of audio 
streams which are listed as entries in the STN_table of 
the current Playltem. When PSR1 changes, the playback 
apparatus plays back an audio stream specified by the 
changed PSR1 . PSR1 is initially set to OxFF, and can be 
reset to any of the values 1 to 32 by the playback appa- 
ratus. The value OxFF is an undefined value, indicating 
that no audio stream is present or no audio stream is 
selected. The values 1 to 32 are interpreted as audio 
stream numbers. 

[0116] FIG. 15A shows status transitions that can be 
made by PSR1 . In the drawing, the term "Valid" denotes 



a state where PSR1 is no greater than the number of 
entries in the STN_table of the current Playltem and also 
the playback apparatus is capable of playing the audio 
stream. 

5 [0117] Meanwhile, the term "Invalid" denotes a state 
where PSR1 is 0 or greater than the number of entries 
in the STN_table of the current Playltem. There may be 
a case where even if PSR1 is no greater than the number 
of entries in the STN_table of the current Playltem, the 

10 playback apparatus is incapable of decoding the audio 
stream. 

[0118] Procedures for setting PSR1 upon a status tran- 
sition are schematically shown in dotted boxes in FIG. 
15A. There are two types of PSR setting procedures, 

15 namely, "Procedure when playback condition is 
changed" and "Procedure when change is requested". 
[0119] "Procedure when playback condition is 
changed" is a procedure to run when the condition of the 
playback apparatus changes due to the occurrence of 

20 some kind of event. 

[0120] "Procedure when YYY change is requested" is 
a procedure to run when the user requests some kind of 
change (stream change in the case of FIG. 15). 
[0121] "Procedure when playback condition is 

25 changed" and "Procedure when change is requested" 
shown in the dotted boxes are the stream selection pro- 
cedures that constitute the principal features of the 
present invention, and will be explained in detail later with 
reference to flowcharts. 

30 [0122] Each arrow in FIG. 15A represents a status 
transition of PSR1. 

[01 23] A comment accompanying each arrow denotes 
an event which triggers a status transition. In detail, when 
any of "Load a disc", " Change a Stream", "Start PlayList 

35 playback", "Cross a Playltem boundary", and "Terminate 
PlayList playback" occurs, PSR1 undergoes a status 
transition. In view of this notation, it can be understood 
from FIG. 1 5A that none of the above procedures is per- 
formed upon a status transition from Invalid to Invalid and 

40 a status transition from Valid to Invalid. On the other hand, 
each of a status transition from Invalid to Valid and a 
status transition from Valid to Valid passes one of the 
procedures. In other words, to set Valid PSR1, "Proce- 
dure when playback condition is changed" or "Procedure 

45 when change is requested" is carried out. 

[0124] The events which trigger status transitions are 
explained below. 

[0125] "Load a disc" is an event of loading the BD- 
ROM to the playback apparatus. Upon loading, PSR1 is 

50 initially set to an undefined value (OxFF). 

[01 26] "Start PlayList playback" is an event of starting 
playback based on a PlayList. When this event occurs, 
"Procedure when playback condition is changed" is per- 
formed, and PSR1 becomes Valid. 

55 [0127] "Terminate PlayList playback" is an event of 
ending playback based on a PlayList. When this event 
occurs, "Procedure when playback condition is changed" 
is not performed, and PSR1 becomes Invalid. 
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[0128] "Change XXX" is an event of receiving a user 
request to switch XXX (stream in the case of FIG. 15). 
When this event occurs while PSR1 is Invalid (Cj1 in FIG. 
15A), PSR1 is set to a value requested by the user. Even 
if this set value shows a valid audio stream number, PSR1 
is treated as Invalid. Thus, a PSR which is Invalid never 
changes to Valid by "Change XXX". 
[0129] When "Change a Stream" occurs while PSR1 
is Valid (Cj2), on the other hand, "Procedure when 
change is requested" is performed and a new value is 
assigned to PSR1. The value assigned to PSR1 here 
may not be the value requested by the user. This is be- 
cause "Procedure when change is requested" has afunc- 
tion of excluding an invalid value. PSR1 which is Valid 
never changes to Invalid by "Change a Stream", since 
"Procedure when change is requested" ensures not to 
make PSR1 Invalid. 

[01 30] "Cross a Playltem boundary" is an event where 
playback crosses over a Playltem boundary. The Play- 
Item boundary refers to here is a point between an end 
of one Playltem and a beginning of an immediately suc- 
ceeding Playltem. When this event occurs while PSR1 
is Valid, "Procedure when playback condition is changed" 
is performed. After "Procedure when playback condition 
is changed", PSR1 either returns to Valid or moves to 
Invalid. Since an STN_table is provided for each Play- 
ltem, playable elementary streams change when the cur- 
rent Playltem changes. Accordingly, "Procedure when 
playback condition is changed" is performed for each 
Playltem so as to set PSR1 to a value optimal for the 
Playltem. 

[0131] FIG. 15B is a flowchart of "Procedure when 
playback condition is changed" for PSR1 . This procedure 
sets PSR1 through a combination of two judgment steps 
S1 and S2. 

[0132] First, a judgment is made as to whether the 
number of entries in the STN_table is 0 (S1 ). If the number 
of entries in the STN_table is 0, the value of PSR1 is 
maintained (S3). 

[0133] When the number of entries in the STN_table 
is not 0, a judgment is made as to whether the number 
of entries in the STN_table is no smaller than PSR1 and 
also condition (A) is true (S2). Condition (A) is that the 
playback apparatus has a capability of playing an audio 
stream specified by PSR1 . If the judgment in step S2 is 
YES, the value of PSR1 is maintained (S4). If PSR1 is 
greater than the number of entries in the STN_table or 
Condition (A) is false, PSR1 is set to a new value (S5). 
[0134] FIG. 16 is a flowchart of a detailed procedure 
of step S5. 

[0135] Steps S6 and S7 form a loop in which step S8 
is performed for each audio stream listed in the STN_ 
table. In this loop, an audio stream subjected to process- 
ing is called audio stream i. A judgment is made as to 
whether audio stream i satisfies three conditions (a), (b), 
and (c) (S8). 

[0136] Condition (a) is that the playback apparatus has 
a capability of playing audio stream i. This judgment is 



made by comparing PSR15 and a stream_coding_type 
of audio stream i shown in the STN_table. 
[0137] Condition (b) is that a language attribute of au- 
dio stream i is same as the language setting of the play- 

5 back apparatus. This judgment is made by checking 
whether an audio_language_code of audio stream i 
shown in the STN_table matches PSR16. 
[01 38] Condition (c) is that a channel attribute of audio 
stream i is surround and the playback apparatus has a 

10 surround output capability. This judgment is made by 
comparing PSR15 with an audio_presentation_type and 
the stream_coding_type of audio stream i shown in the 
STN_table. 

[0139] The following explains a case where condition 
15 (c) is satisfied, with reference to FIG. 17. FIG. 17 shows 
combinations of capabilities of the playback apparatus 
and stream attributes in a tabular form. The capabilities 
of the playback apparatus include stereo output and sur- 
round output. The stream attributes include stereo and 
surround. 

[01 40] When the playback apparatus has a stereo out- 
put capability and the attribute of audio stream i is stereo, 
audio stream i can be played back. 
[0141] When the playback apparatus has a surround 
output capability and the attribute of audio stream i is 
stereo, audio stream i can be played back. 
[0142] When the playback apparatus has a surround 
output capability and the attribute of audio stream i is 
surround, audio stream i can be played back. 
[01 43] When the playback apparatus has a stereo out- 
put capability and the attribute of audio stream i is sur- 
round, audio stream i can still be played back if the play- 
back apparatus downmixes AC-3 (5.1ch) to AC-3 (2ch). 
Thus, audio stream i can be play back with any of the 
four combinations of the capabilities of the playback ap- 
paratus and the channel attributes of audio stream i. How- 
ever, condition (c) is defined to be true only with one of 
the four conditions, namely, the playback apparatus has 
a surround output capability and the channel attribute of 
audio stream i is surround. Thus, a strict condition is given 
as condition (c). 

[0144] Though condition (c) is defined to be true only 
with the above combination, this is merely one example, 
and condition (c) may be defined to be true also with the 
combination in which the playback apparatus has a ster- 
eo output capability and the channel attribute of audio 
stream i is stereo. In this case, if the playback apparatus 
is only capable of stereo output or has been set to prior- 
itize stereo output over surround output, stereo playback 
of a 2ch audio stream is selected over downmixed play- 
back of a 5.1ch audio stream. 

[0145] Based on a pattern of conditions audio stream 
i satisfies, that is, which conditions and how many con- 
ditions audio stream i satisfies among the three condi- 
tions, a priority is given to audio stream i. 
[0146] After the loop is performed for each audio 
stream, steps S9 to S13 are performed. A judgment is 
made as to whether no audio stream satisfies condition 
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(a) (S9). If there is no audio stream which satisfies con- 
dition (a), PSR1 is set to the undefined value (OxFF) 
(S14). 

[0147] A judgment is made as to whether there is any 
audio stream that satisfies all conditions (a), (b), and (c) 
(S1 0). If there is such an audio stream, PSR1 is set to a 
stream number of that audio stream (S15). 
[0148] Here, if there are two or more audio streams 
that satisfy conditions (a), (b), and (c), these audio 
streams are equal in priority. In such a case, one of the 
audio streams is selected according to the order of entries 
in the STN_table (S15). Which is to say, if there are two 
or more audio streams that have a same combination of 
codec, language attribute, and channel attribute, one of 
the audio streams which has a highest entry in the STN_ 
table is selected as a highest-priority audio stream. 
[0149] Suppose there are three audio streams that 
have a same combination of codec, language attribute, 
and channel attribute and respectively correspond to 
main program sound, commentary sound, and BGM. In 
this case, an entry of the audio stream corresponding to 
the main program sound is placed first in the SIN_table, 
which is followed by an entry of the audio stream corre- 
sponding to the commentary sound and an entry of the 
audio stream corresponding to the BGM, as shown in 
FIG. 18. As a result, the main program sound is selected 
automatically over the commentary sound and the BGM. 
[0150] Thus, by adjusting the order of audio stream 
entries in the STN_table, the author can exercise audio 
stream selection control, i.e. the author can specify which 
audio stream is selected for playback. 
[01 51 ] When there is no audio stream that satisfies all 
conditions (a), (b), and (c), a judgment is made as to 
whether there is any audio stream that satisfies condi- 
tions (a) and (b) (S1 1). If there is any audio stream that 
satisfies conditions (a) and (b), PSR1 is set to a stream 
number of an audio stream having a highest entry in the 
STN_table among the audio streams satisfying condi- 
tions (a) and (b) (S16) . 

[0152] When there is no audio stream that satisfies all 
conditions (a), (b), and (c) and no audio stream that sat- 
isfies conditions (a) and (b), a judgment is made as to 
whether there is any audio stream that satisfies condi- 
tions (a) and (c) (S12). If there is any audio stream that 
satisfies conditions (a) and (c), PSR1 is set to a stream 
number of an audio stream having a highest entry in the 
STN_table among the audio streams satisfying condi- 
tions (a) and (c) (S17). 

[0153] When there is no audio stream that satisfies all 
conditions (a), (b), and (c), no audio stream that satisfies 
conditions (a) and (b), and no audio stream that satisfies 
conditions (a) and (c), a judgment is made as to whether 
there is any audio stream that satisfies condition (a) 
(S13) . If there is any audio stream that satisfies condition 
(a), PSR1 is set to a stream number of an audio stream 
having a highest entry in the STN_table among the audio 
streams satisfying condition (a) (S18). 
[0154] This completes "Procedure when playback 



condition is changed". The following describes "Proce- 
dure when change is requested". FIG. 19 is a flowchart 
of "Procedure when change is requested" for PSR1 . The 
difference between this flowchart and the flowchart of 
5 FIG. 15B lies in that X is subjected to judgment instead 
of PSR1 . The value X is based on user operation infor- 
mation output from the operation reception unit 29 or a 
button command output from the Interactive Graphics 
Decoder 13. 

10 [0155] A judgment is made as to whether the number 
of entries in the STN_table is no smaller than X and also 
condition (A) is true (S1 9). Condition (A) is that the play- 
back apparatus is capable of playing an audio stream 
specified by X. This judgment is made by comparing 

15 PSR15 and a stream_coding_type of the audio stream 
shown in the STN_table. If the judgment in step S19 is 
YES, PSR1 is set to X (S21). 

[0156] If X is greater than the number of entries in the 
STN table or condition (A) is false, a judgment is made 

20 as to whether X is OxFF (S22). If X is not OxFF, it means 
the audio stream number requested by the user is invalid, 
so that the value of PSR1 is maintained with the user- 
designated value X being ignored (S23). 
[0157] If PSR1 is OxFF, PSR1 is set to a new value 

25 (S24). A procedure of step 24 is similar to the procedure 
of step S5 shown in FIG. 1 6, except for the following. The 
judgment of step S9 is not needed in "Procedure when 
change is requested", because "Procedure when change 
is requested" maintains the value of PSR1 without setting 

30 PSR1 to the user-designated value X if there is no audio 
stream that satisfies any of conditions (a), (b), and (c). 
[01 58] According to the above "Procedure when play- 
back condition is changed" and "Procedure when change 
is requested", an audio stream that is playable by the 

35 playback apparatus and that makes full use of both the 
features of the BD-ROM and the playback apparatus can 
be selected. 

<Specific Examples of PSR1 Setting> 

40 

[01 59] The procedures shown in the above flowcharts 
are explained using specific examples below. 
[0160] In one specific example, the playback appara- 
tus is a middle-level playback apparatus. The middle- 
45 level playback apparatus referred to here does not have 
a DTS decoding capability but has an LPCM decoding 
capability and an AC-3 surround output capability. Also, 
the language setting of the playback apparatus is Japa- 
nese. 

50 [0161] Suppose the BD-ROM on which an STN_table 
shown in FIG. 20B is recorded is loaded to this playback 
apparatus. This STN_table lists entries of six audio 
streams. 

[0162] This being the case, for each audio stream, a 
55 judgment is made as to whether conditions (a), (b), and 
(c) are satisfied in step S8 in FIG. 1 6. For example, audio 
stream 1 which is listed first in the STN_table satisfies 
only condition (a). Audio stream 2 which is listed second 
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in the STN_table satisfies conditions (a) and (c). 
[01 63] The judgment on all audio streams reveals that 
audio stream 5 satisfies all conditions (a), (b), and (c), 
audio stream 4 satisfies conditions (a) and (b), audio 
stream 2 satisfies conditions (a) and (c), and audio 
stream 1 satisfies condition (a). The other audio streams 
are excluded from selection since they do not satisfy con- 
dition (a). 

[0164] Based on this result, a highest priority is given 
to audio stream 5 that satisfies all conditions (a), (b), and 
(c), as shown in FIG. 20C. Hence audio stream 5 is se- 
lected and played together with a video stream. 
[0165] In the above example, the audio stream that 
satisfies all conditions (a), (b), and (c) is selected. The 
following considers a case where the playback apparatus 
does not have a surround output capability. Suppose the 
playback apparatus does not have a surround output ca- 
pability, and an AC-3 (2ch) audio stream and an AC-3 
(5.1 ch) audio stream are multiplexed in an AV Clip on 
the BD-ROM. According to FIG. 17, both of the audio 
streams are playable. Therefore, when these audio 
streams undergo the judgment in the procedure shown 
in FIG. 16, the audio streams will end up being equal in 
priority. 

[0166] In such a case, the STN_table is referenced to 
select one of the audio streams. Even if the playback 
apparatus is incapable of surround output, the playback 
apparatus can still play back the AC-3 (5.1ch) audio 
stream by downmixing it to AC-3 (3ch). Such downmix- 
ing, however, may result in a lower audio quality at the 
time of playback than the one intended by the author. On 
the other hand, the AC-3 (2ch) audio stream is originally 
intended for stereo output. In view of this, the author may 
prefer AC-3 (2ch) playback to downmixed AC-3 (5.1 ch) 
playback. 

[0167] In this case, the author places an entry of the 
AC-3 (2ch) audio stream above an entry of the AC-3 
(5.1 ch) audio stream in the STN_table. 
[0168] As a result, the playback apparatus without a 
surround output capability plays not downmixed AC-3 
(5.1ch) audio but AC-3 (2ch) audio. With regard to a bit 
rate, on the other hand, the AC-3 (5.1ch) audio stream 
has a bit rate of 384 Kbps whereas the AC-3 (2ch) audio 
stream has a bit rate of 1 92 Kbps. Thus, the AC-3 (5.1 ch) 
audio stream has a higher bit rate than the AC-3 (2ch) 
audio stream. The author may consider this more impor- 
tant than the audio quality, and prefer downmixed AC-3 
(5.1 ch) playback to AC-3 (2ch) playback. In this case, 
the author places the entry of the AC-3 (5.1 ch) audio 
stream above the entry of the AC-3 (2ch) audio stream 
in the STN_table. 

[0169] As a result, the playback apparatus without a 
surround output capability plays not AC-3 (2ch) audio but 
downmixed AC-3 (5.1ch) audio. 

[0170] The following gives an example of STN_table 
description and audio stream selection when the author 
prefers AC-3 (2ch) playback to downmixed AC-3 (5.1 ch) 
playback, by referring to FIG. 21. 



[0171] In this example, the playback apparatus does 
not have a surround output capability, so that PSR1 5 and 
PSR16 are set as shown in FIG. 21 A. Meanwhile, the 
STN_table has the same contents as the one in FIG. 

5 20B, as shown in FIG. 21 B. In such a case, audio stream 
4 and audio stream 5 that satisfy conditions (a) and (b) 
have the same priority "1 ", and audio stream 1 and audio 
stream 2 that satisfy condition (a) have the same priority 
"2" . Since audio streams 4 and 5 are equal in priority, 

10 the playback apparatus selects one of audio streams 4 
and 5 based on the order of entries in the STN_table. 
Since the author prefers AC-3 (2ch) playback to down- 
mixed AC-3 (5. 1 ch) playback, the entry of the AC-3 (2ch) 
audio stream is higher than the entry of the AC-3 (5.1 ch) 

15 audio stream in the STN_table shown in FIG. 21 B. In 
other words, audio stream 4 has a higher entry than audio 
stream 5 in the STN _table Therefore, the playback ap- 
paratus selects audio stream 4 and plays audio stream 4. 
[0172] The following explains an example of STN_ta- 

20 ble description and audio stream selection when the au- 
thor prefers downmixed AC-3 (5.1ch) playback to AC-3 
(2ch) playback, by referring to FIG. 22. 
[0173] Since the author prefers downmixedAC-3 
(5.1ch) playback, the AC-3 (5.1ch) audio streams (audio 

25 streams 2 and 5) respectively have higher entries than 
the AC-3 (2ch) audio streams (audio streams 1 and 4) in 
the STN_table shown in FIG. 22B. Which is to say, audio 
stream 5 is placed above audio stream 4 in the STN_ 
table. Accordingly, when audio streams 4 and 5 satisfy 

30 the same conditions (a) and (b), the playback apparatus 
selects audio stream 5 and plays audio stream 5, as 
shown in FIG. 22C. 

[0174] Thus, the author can determine which of AC-3 
(2ch) playback and downmixed AC-3 (5.1 ch) playback 
35 is performed when the playback apparatus does not have 
a surround output capability. This makes it possible to 
realize playback control that reflects the preference of 
the author. This concludes the description of the status 
control regarding PSR1. 

40 

<Status Transitions of PSR2> 

[0175] The following describes PSR2. PSR2 is used 
to specify which of a plurality of PG streams and textST 

45 streams listed as entries in the STN_table of the current 
Playltem is to be played. When PSR2 is changed, the 
playback apparatus plays back a PG stream or a textST 
stream specified by the changed PSR2. PSR2 is initially 
set to an undefined value, and can be set to one of the 

50 values 1 to 255 by the playback apparatus. The undefined 
value is OxFFFF, indicating that no PG stream or textST 
stream is present or no PG stream or textST stream is 
selected. The values 1 to 255 are interpreted as PG_ 
textST_stream numbers. FIG. 23A shows status transi- 

55 tions that can be made by PSR2. The status transitions 
shown in FIG. 23A are same as those shown in FIG. 1 5A. 
FIG. 23B is a flowchart of "Procedure when playback 
condition is changed" for PSR2, and FIG. 24 isaflowchart 
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of "Procedure when change is requested" for PSR2. 
These flowcharts are respectively similar to those in 
FIGS. 1 5B and 1 9, but substantially differ in a PSR2 set- 
ting procedure in steps S5 and S23. 
[0176] FIG. 25 is a flowchart of the PSR2 setting pro- 
cedure. 

[0177] In the drawing, steps S31 and S32 form a loop 
in which steps S33 to S35 are performed for each PG_ 
textST_stream listed in the STN_table. In this loop, the 
PG_textST_stream subjected to processing is called 
PG_textST_stream i. A judgment is made as to whether 
a stream_coding_type of PG_textST_stream i shown in 
the STN_table is 0x90 or 0x92 (S33). If the stream_ 
coding_type is 0x90, the procedure advances to step 
S34. 

[0178] A judgment is made as to whether PG_textST_ 
stream i satisfies the following conditions (a) and (b) 
(S34). 

[0179] Condition (a) is that the playback apparatus is 
capable of playing PG stream i. 

[0180] Condition (b) is that a language attribute of PG 
stream i matches the language setting of the playback 
apparatus. 

[0181] The judgment for condition (b) is made by 
checking whether a PG_language_code of PG stream i 
shown in the STN_table matches PSR17. 
[0182] If the stream_coding_type is 0x92, a judgment 
is made as to whether PG_textST_stream i satisfies the 
following conditions (a) and (b) (S35). 
[0183] Condition (a) is that the playback apparatus is 
capable of playing textST stream i. 
[0184] Condition (b) is that a language attribute of 
textST stream i matches the language setting of the play- 
back apparatus. 

[0185] The judgment for condition (a) is made by 
checking whether PSR30 shows "capable". The judg- 
ment for condition (b) is made by checking whether a 
textST_language_code of textST stream i shown in the 
STN_table matches PSR17. 

[0186] After steps S33 to S35 are performed for all 
PG_textST_streams, the procedure advances to steps 
S36 to S41. 

[0187] A judgment is made as to whether there is no 
PG_textST_stream that satisfies condition (a) (S36). If 
there is no PG_textST_stream that satisfies condition (a), 
PSR2 is set to an invalid value (OxFFFF) (S38). 
[0188] A judgment is made as to whether there is any 
PG_textST_stream that satisfies conditions (a) and (b) 
(S37). If there is such a PG_textST_stream, PSR2 is set 
to a stream number of a PG_textST_stream having a 
highest entry in the STN_table among PG_textST_ 
streams satisfying conditions (a) and (b) (S39). 
[0189] If the judgment in step S37 is NO, PSR2 is set 
to a stream number of a stream having a highest entry 
in the STN_table among PG streams satisfying condition 
(a) and textST_streams satisfying condition (a) (S41). 
The procedure of this flowchart is explained in more detail 
below, using specific 



examples. 

<Specific Examples of PSR2 Setting> 

5 [0190] In one specific example, the playback appara- 
tus is capable of decoding a PG stream but incapable of 
decoding a textST stream, as shown in FIG. 26A. Also, 
the language setting of the playback apparatus is Japa- 
nese. 

10 [0191] Suppose the BD-ROM on which an STN_table 
shown in FIG. 26B is recorded is loaded to this playback 
apparatus. The STN_table has entries of two textST 
streams (PG_textST_streams 1 and 3) and two PG 
streams (PG_textST_streams 2 and 4). 

15 [0192] This being the case, steps S34 and S35 are 
performed to judge, for each PG_textST_stream, wheth- 
er conditions (a) and (b) are satisfied, as shown in FIG. 
26C. Here, PG_textST_streams 1 and 3 do not satisfy 
condition (a), PG textST stream 2 satisfies only condition 

20 (a), and PG_textST_stream 4 satisfies both conditions 
(a) and (b). 

[01 93] The judgment on all PG_textST_st reams in the 
STN_table reveals that PG_textST_stream 4 satisfies 
conditions (a) and (b) and PG_textST_stream 2 satisfies 
25 condition (a). PG_textST_streams 1 and 3 do not satisfy 
condition (a) and so are excluded from selection. 
[0194] As a result, PG_textST_stream 4 is given a 
highest priority. 

[0195] If there are two or more PG_textST_st reams 

30 that satisfy same conditions, on the other hand, these 

PG_textST streams are equal in priority. In such a 

case, one of the PG_textST_streams is selected based 

on the order of entries in the STN_table. 

[0196] A specific example of PG_textST_stream se- 

35 lection according to the order of entries in the STN_table 
is given below, by referring to FIG. 27. In this specific 
example, the playback apparatus is capable of decoding 
both a PG stream and a textST stream. When there are 
a PG stream and a textST stream that have a language 

40 attribute which matches the language setting of the play- 
back apparatus, the PG stream and the textST stream 
are equal in priority. In this case, the author places an 
entry of a preferred stream above an entry of the other 
stream in the STN_table. If the author prefers the textST 

45 stream to the PG stream, the author places an entry of 
the textST stream above an entry of the PG stream in 
the STN_table. As a result, the textST stream is selected 
automatically over the PG stream. 
[0197] Thus, by adjusting the order of entries in the 

50 STN_table, the author can exercise selection control of 
which stream is to be selected at the time of playback. 

<Modifications> 

55 [0198] The first embodiment describes the case where 
if X is invalid in "Procedure when change is requested", 
the transition control unit 30 maintains the value of PSR1 
or PSR2. This process is not desirable, however, in the 
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case where the user presses the audio switch key or the 
subtitle switch key. When the audio switch key or the 
subtitle switch key is pressed, X should be PSR + 1. If, 
despite this, the value of PSR1 or PSR2 is maintained 
on the ground that X is invalid, the user may think that 5 
the playback apparatus malfunctions. 
[0199] In view of this, when the audio switch key or the 
subtitle switch key is pressed, the transition control unit 
30 performs the following process in addition to "Proce- 
dure when change is requested". In this process, when 10 
executing "Procedure when change is requested", the 
value of the PSR before "Procedure when change is re- 
quested" is compared with the value of the PSR after 
"Procedure when change is requested". If the two values 
are equal, X is incremented by 1 , and "Procedure when 15 
change is requested" is performed again. X is increment- 
ed until the value of the PSR is updated by "Procedure 
when change is requested". 

[0200] Once the value of the PSR has been updated 
by "Procedure when change is requested", the compar- 20 
ison of the two values results in a mismatch. The value 
of the PSR obtained by "Procedure when change is re- 
quested" at this point is used for stream selection. 
[0201] This process is explainedbrieflybelow, usin- 
gaspecific example where PSR1 is set to 3 and stream 25 
numbers 4 and 5 are invalid. The transition control unit 
30 adds 1 to PSR1 , and sets 4 as X. The transition control 
unit 30 then performs "Procedure when change is re- 
quested". Since the stream number 4 is invalid, PSR1 
remains 3. When PSR1 is unchanged like this, the tran- 30 
sition control unit 30 increments X by 1 , to thereby set X 
to 5. Having done so, the transition control unit 30 per- 
forms "Procedure when change is requested" again. 
Since the stream number 5 is invalid, PSR1 remains 3. 
When PSR1 is unchanged like this, the transition control 35 
unit 30 increments X by 1 , to thereby set X to 6. Having 
done so, the transition control unit 30 performs "Proce- 
dure when change is requested" again. Since the stream 
number 6 is valid, the stream number 6 is automatically 
selected as a result of "Procedure when change is re- 40 
quested". By performing the above process when the 
audio switch key is pressed, smooth audio switching can 
be achieved without making the user notice the existence 
of an invalid stream number. 

45 

Second Embodiment 

[0202] A second embodiment of the present invention 
relates to status settings for multi-angle blocks. A data 
structure for realizing a multi-angle block can be provided 50 
in the Playltem information shown in FIG. 5. FIG. 28 
shows a data structure of Playltem information corre- 
sponding to a multi-angle block. In the drawing, the Play- 
ltem information is made up of a basic part that is com- 
patible with Playltem information corresponding to a non- 55 
multi-angle block, and an extension part for realizing the 
multi-angle block. The basic part has a same data struc- 
ture as the one shown in FIG. 5, and includes a Clip 



Information file name field, a Clip_codec_identifier 

field, an IN_time field, an OUTJime field, and an STN_ 
table field. In the multi-angle block, an AV Clip specified 
by this basic part is treated as a first angle block. In this 
way, even if a playback apparatus that does not support 
multi-angle (a playback apparatus that corresponds only 
to a BD-RE data structure) reads Playltem information 
corresponding to a multi-angle block, the playback ap- 
paratus can play the first angle block by referencing the 
basic part. Meanwhile, the extension part is made up of 
an is_multi_angles field, a number_of_angles field, and 
Angle information [2], ... , []]. 

[0203] The is_multi_angles field shows whether a 
playback section corresponding to the Playltem informa- 
tion is a multi-angle block or a non-multi-angle block. 
[0204] The number_of_angles field shows, when the 
is_multi_angles field shows a multi-angle block, the 
number of angles in the multi-angle block. 
[0205] The Angle information [2], ... , [j] is information 
for each individual angle block in the multi-angle block, 
and includes a Clip_lnformation_file_name field and a 
Clip_codec identifier field. 

[0206] The Clip_lnformation_file_name field shows a 
filename of an AV Clip that forms the angle block. 
[0207] The Clip_codec_identifier field shows a coding 
method of the AV Clip specified by the filename shown 
by the Clip_lnformation_file_name field in the Angle in- 
formation. 

[0208] As shown in the drawing, the Angle information 
does not have an IN_time field and an OUTJime field. 
This is because a beginning and end of each angle block 
except the first angle block are specified by the IN_time 
field and the OUTJime field in the basic part. In other 
words, a playback time of the AV Clip specified by the 
Clip_lnformation_file_name field in the Angle information 
needs to be same as a playback time of the AV Clip spec- 
ified by the Clip_lnformation_file name field in the basic 
part. Also, time stamps (System Time Clock) which spec- 
ify presentation timings on the AV Clip playback time axis 
need to be equal for the two AV Clips. 
[0209] A specific example of a Playltem corresponding 
to a multi-angle block is given below. In this specific ex- 
ample, three Playltems (Playltems #1, #2, and #3) are 
used. Of these Playltems, Playltems #1 and #3 constitute 
multi-angle blocks, whereas Playltem #2 constitutes a 
non-multi-angle block. Also, a plurality of AV Clips shown 
in FIG. 29 (FRONT1, RIGHT1, LEFT1, FRONT2, 
FRONT3, and RIGHT 2) are recorded on the BD-ROM. 
Clip_lnformation_file_names of Playltem #1 specify 
FRONT1 , LEFT1 , and RIGHT1 , a Clip_lnformation_file_ 
name of Playltem #2 specifies FRONT2, and Clip_ 
lnformation_file_names of Playltem #3 specify FRONT3 
and RIGH12 . These Playltems def a main path that is 
made up of a multi-angle block, a non-multi-angle block, 
and a multi-angle block in this order FIGS. 30A and 30B 
show the multi-angle blocks and non-multi-angle block 
defined in this way. In the drawing, arrows my1 and my2 
indicate designation by two sets of Angle information in 
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Playltem #1 , and arrow my3 indicates designation by one 
set of Angle information in Playltem #3. According to the 
designation my1 and my2 by the two sets of Angle infor- 
mation in Playltem #1, one of RIGHT1 and LEFT1 can 
be selected for playback instead of part of the AV Clip. 
Likewise, according to the designation my3 by the set of 
Angle information in Playltem#3, RIGHT2 can be select- 
ed for playback instead of part of the AV Clip. 
[0210] FIG. 30B shows a progress of playback of the 
multi-angle blocks and non-multi-angle block. As indicat- 
ed by arrows ag1, ag2, and ag3, one of the three angle 
blocks can be selected in multi-angle block 1. Also, as 
indicated by arrows ag4 and ag5, one of the two angle 
blocks can be selected in multi-angle block 3. This con- 
cludes the description of the improvements in the record- 
ing medium of the second embodiment. 
[0211] The following describes improvements in the 
playback apparatus of the second embodiment. In the 
playback apparatus, PSR3 specifies an angle block. In 
the second embodiment, the control unit 24 controls an- 
gle block selection and playback according to PSR3. 
[0212] In detail, the control unit 24 references PSR3, 
upon playback of the current Playltem in thecurrent Play- 
List. If PSR3 = 1 , the control unit 24 controls the BD-ROM 
drive 1 to access an AV Clip specified by a Clipjnfor- 
mation file name in the basic part of the current Playltem 
and read TS packets of the AV Clip from an IN_time to 
an OUT_time in the current Playltem. The read TS pack- 
ets are fed to the Video Decoder 4 to play an angle block. 
[021 3] If PSR3 is 2 or more, the control unit 24 controls 
the BD-ROM drive 1 to access an AV Clip (aforemen- 
tioned RIGHT1 , LEFT1 , or RIGHT2) specified by a Clip_ 
lnformation_file_name in Angle Information in the exten- 
sion part of the current Playltem, and read TS packets 
of the AV Clip. The read TS packets are fed to the Video 
Decoder 4 to play an angle block. Thus, by accessing a 
different AV Clip depending on the value of PSR3, se- 
lective playback of angle blocks can be achieved. 
[0214] PSR3 which specifies an angle block is ex- 
plained below. FIG. 31 shows settings of PSR3. PSR3 
specifies a number of an angle block that is currently 
selected. PSR3 takes one of the values 1 to 9, to specify 
one of angle blocks 1 to 9. 

[021 5] Status transitions of PSR3 are explained below. 
FIG. 32A shows status transitions that can be made by 
PSR3. When comparing this drawing with FIG. 15A, it 
can be understood that there is no status transition trig- 
gered by "Cross a Playltem boundary". Also, "Start Play- 
List playback" and "Terminate PlayList playback" have 
been replaced respectively with "Start Playltem with multi 
angle structure" and "End of a Playltem with multi angle 
structure". Further, "Procedure when change is request- 
ed" has been changed from "stream change is request- 
ed" to "angle change is requested". Apart from these dif- 
ferences, the status transitions of PSSR3 are same as 
those shown in FIG. 15A. 

[0216] The number of audio streams differs for each 
Playltem. Accordingly, when playback of a PlayList starts 



and each time the playback crosses a Playltem bound- 
ary, "Procedure when playback condition is changed" 
needs to be performed to set PSR1 . On the other hand, 
PSR3 is used only in a multi-angle block, and so there 
5 is no need to perform "Procedure when playback condi- 
tion is changed" each time a Playltem boundary is 
crossed. Therefore, a status transition from Invalid to Val- 
id is triggered by a start of playback of a multi-angle block, 
and a status transition from Valid to Invalid is triggered 
10 by an end of playback of a multi-angle block. 

[0217] In this embodiment, the value of PSR3 is main- 
tained upon the status transition from Valid to Invalid. 
Which is to say, when a multi-angle block and a non- 
multi-angle block appear alternately (e.g. FIG. 30), only 
15 the state of PSR3 is changed from Valid to Invalid and 
vice versa, without changing the value of PSR3. This 
concludes the description of the status transitions of 
PSR3. The following describes "Procedure when play- 
back condition is changed" and "Procedure when change 
20 is requested" for PSR3. 

[0218] FIG. 32B is a flowchart of "Procedure when 
playback condition is changed" for PSR3. This flowchart 
has a similar algorithm to the one shown in FIG. 15B. A 
judgment is made as to whether the number of angles in 
25 the current Playltem is no smaller than PSR3 (S51). If 
the number of angles in the current Playltem is no smaller 
than PSR3, the value of PSR3 is maintained (S53). Oth- 
erwise, PSR3 is set to an initial value "1" (S52). 
[0219] FIG. 32C is a flowchart of "Procedure when 
30 change is requested" for PSR3. This flowchart has a sim- 
ilar algorithm to the one shown in FIG. 1 9. A judgment is 
made as to whether the number of angles in the current 
Playltem is no smaller than X (S54). If the number of 
angles in the current Playltem is no smaller than X, PSR3 
35 is set to X (S57). Otherwise, the value of PSR3 is main- 
tained (S55). 

[0220] Angle block selection performed when playing 
the multi-angle block, the non-multi-angle block, and the 
multi-angle block in this order according to the three Play- 
40 Items shown in FIG. 30 is explained below, by referring 
to FIG. 33. 

[0221] In FIG. 33A, PSR3 is set to 2. This being so, 
when playback of Playltem #1 starts, the control unit 24 
selects an angle block (RIGHT1 ) specified by PSR3 = 2 
45 and plays the selected angle block. Once the playback 
of RIGHT1 ends, PSR3 is changed to Invalid while being 
held at 2. 

[0222] Multi-angleblock#1 specified by Playltem#1 is 
followed by non-multi-angle block #2 specified by Play- 
50 item #2. Since this is a non-multi-angle block, PSR3 re- 
mains Invalid. Which is to say, PSR3 is treated as Invalid 
while being held at 2. Since PSR3 is Invalid, the control 
unit 24 plays part of the AV Clip (XXX.M2TS) from an 
IN_time to an OUTJime of Playltem #2, irrespective of 
55 the value of PSR3. 

[0223] Non-multi-angle block #2 is followed by multi- 
angle block #3 specified by Playltem #3. When playback 
of multi-angle block #3 begins, PSR3 is changed from 
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Invalid to Valid while being held at 2. Since PSR3 be- 
comes Valid, an angle block specified by PSR3 is select- 
ed. Here, PSR3 = 2, so that the control unit 24 selects 
an angle block (RIGHT2) specified by PSR3 = 2 and plays 
the selected angle block. Arrow gg1 in FIG. 33A indicates 
a course of angle block selection described above. 
[0224] The above concerns the case where PSR3 is 
set to 2. The following explains the case where PSR3 is 
set to 3. In FIG. 33B, playback of multi-angle block #1 is 
performed as in FIG. 33A. After this, PSR3 is changed 
to Invalid while being held at 3 as a result of the status 
transition shown in FIG. 32A, and playback of non-multi- 
angle block #2 is performed in this state. After the play- 
back of non-multi-angle block #2, playback of multi-angle 
block #3 starts. Since this is the "Start Playltem with multi 
angle structure" event, "Procedure when playback con- 
dition is changed" is performed. In step S51 in FIG. 32B, 
a judgment is made as to whether PSR3 exceeds the 
number of angles in Playltem #3. Since the number of 
angles in Playltem #3 is 2, PSR3 = 3 exceeds the number 
of angles. Accordingly, PSR3 is set to 1 (S52). As a result, 
the AV Clip XXX.M2TS corresponding to the first angle 
block in Playltem #3 is selected and played back, as 
shown in FIG. 33B. Arrow gg2 in FIG. 33B indicates a 
course of angle block selection in this case. 
[0225] According to the second embodiment, PSR3 
makes such status transitions that avoid selecting a non- 
existent angle block. Accordingly, even when switching 
from a multi-angle block to a non-multi-angle block and 
vice versa occur frequently, a wrong number will not be 
set in PSR3. This ensures the accuracy in angle selec- 
tion, with it being possible to facilitate distribution of movie 
films that incorporate multi-angle. 

Third Embodiment 

[0226] A third embodiment of the present invention re- 
lates to status settings when executing an interactive 
function. The interactive function referred to here pro- 
vides a plurality of Pages, places graphics Button mem- 
bers on each Page, and receives a user operation. When 
executing the interactive function, this embodiment per- 
forms status settings about which Page is to be displayed 
and which Button on that Page is to be focused. 

<Data Structure for the Interactive Function> 

[0227] A data structure for displaying a plurality of Pag- 
es and Buttons can be provided in the IG stream de- 
scribed in the first embodiment. The IG stream is ex- 
plained below, with reference to FIG. 34. The IG stream 
includes an ICS, a PDS, and an ODS. The ODS is graph- 
ics data for displaying a Button graphically. The PDS is 
pallet data for specifying a color of the Button. 
[0228] The ICS is control information for displaying a 
Page synchronously with a moving picture. The synchro- 
nization with the moving picture is designated by a DTS 
and a PTS in a PES packet carrying the ICS. That is, the 



DTS in the PES packet carrying the ICS shows a begin- 
ning of a period during which the interactive function is 
valid (a period during which the ICS is Valid). 
[0229] Arrow cu 1 in FIG. 34 indicates a structure of the 

5 ICS in detail. As illustrated, the ICS includes a loading_ 
model field, a user_interface_model field, a composition_ 
time_out_pts field, a selection_time_out_pts field, a 
use r_time_out_du ration field, and page information (1), 
(2), ... , (i), ... , (n) which each correspond to a different 

10 one of a plurality of Pages available for presentation. 
[0230] The loading_model field shows whether the IG 
stream is multiplexed in the AV Clip or is preloaded in 
the playback apparatus separately from the AV Clip. 
[0231 ] The user_interface_model field shows whether 

15 a Page is constantly displayed (Always-on) or popped 
up based on a user operation (Pop-up), during the play- 
back of the moving picture. 

[0232] The composition_time_out_pts field shows an 
end of the period during which the interactive function is 
20 valid. 

[0233] The user_time_out_duration field shows a pe- 
riod of time after which Page display is to time-out if there 
is no user operation. 

[0234] The page information is explained below. Arrow 

25 cu2 in FIG. 34 indicates a structure of the page informa- 
tion in detail. As illustrated, the page information includes 
a page_id field, a UO_mask_table field, an in_effects 
field, an out_effects field, an animation_frame_rate_ 
code field, a default_selected_button_id_ref field, a 

30 default_activated_button_id_ref field, a pallet_id_ref 
field, and button_info (1), (2), ... , (i), ... , (n) each corre- 
sponding to a different one of a plurality of Buttons. 
[0235] The page_id field shows an identifier uniquely 
identifying a Page corresponding to the page information. 

35 [0236] The UO mask table fieldshowspermissions/ 
prohibitions of user operations in a Display Set (DS) to 
which the ICS belongs. If this mask field is set to "Pro- 
hibited" for a user operation, that user operation to the 
playback apparatus is invalid. 

40 [0237] The in_effects field shows a display effect to be 
presented immediately before the Page is displayed. 
[0238] The out_effects field shows a display effect to 
be presented immediately after the Page is removed from 
display. 

45 [0239] The animation_frame_rate_code field shows a 
frame rate to be applied to an animated Button. 
[0240] The default_selected_button_id_reffield shows 
whether a Button to be set in a selected state as default 
when the presentation of the Interactive Display (Page) 

50 begins is determined dynamically or statically. When this 
field is set to OxFF, the Button to be set in the selected 
state as default is determined dynamically. In this case, 
a PSR in the playback apparatus is used preferentially, 
so that a Button specified by PSR1 0 is put in the selected 

55 state. When this field is not set to OxFF, on the other 
hand, the Button to be set in the selected state is deter- 
mined statically. In this case, PSR10 is set to a button 
number shown by the default_selected_button_id_ref, 
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and a Button specified by PSR10 is put in the selected 
state. 

[0241 ] The default activated button id ref shows a But- 
ton to be automatically Set in an activated state if the 
user does not activate any Button before a time defined 
by the selection_time_out_pts. When this field is set to 
FF, the Button currently in the selected state is automat- 
ically set in the activated state at the time defined by the 
selection_time_out_pts. When this field is set to 00, no 
Button is auto-activated. When this field is set to a value 
that is neither 00 nor FF, the value is interpreted as a 
valid button number specifying a Button to be auto-acti- 
vated. 

[0242] The pallet_id_ref field shows an identifier of a 
Palletto be set in a CLUT unit for producing the Interactive 
Display. 

[0243] The button_info field defines a Button to be pre- 
sented on the Interactive Display. FIG. 35 shows a struc- 
ture of the button_info. Guideline hp1 in the drawing 
shows a structure of button_info i of Button i controlled 
by the ICS, in detail. Each individual Button presented 
on the Page has three states that are a normal state, a 
selected state, and an activated state. The normal state 
is a state where the Button is simply displayed. The se- 
lected state is a state where the Button is focused ac- 
cording to a user operation but the selection of the Button 
is not confirmed yet. The activated state is a state where 
the selection of the Button has been confirmed. Since 
Button i has these three states, button_info i has the fol- 
lowing fields. 

[0244] A button_number field specifies a number 
uniquely identifying Button i in the ICS. 
[0245] A numerically_selectableflag field shows a flag 
indicating whether numeric selection is available for But- 
ton i. 

[0246] An auto_action_flag field shows whether Button 
i is to be automatically set in the activated state. When 
the auto_action_flag field is set to ON (bit value "1"), But- 
ton i is changed not to the selected state but directly to 
the activated state, when Button i becomes selected. If 
the auto_action_flag field is set to OFF (bit value "0"), 
Button i is changed not directly to the activated state but 
to the selected state, when Button i becomes selected. 
[0247] A button_horizontal_position field and a 
button_vertical_position field respectively show a hori- 
zontal position and a vertical position of a top left pixel 
of Button i in the Interactive Display. 
[0248] An upper_button_number field shows a button 
number of a Button to receive the selected state when a 
user operation of pressing the Move Up key is made while 
Button i is in the selected state. If this field shows the 
button number of Button i, then a user operation of press- 
ing the Move Up key is ignored. 

[0249] A lower_button_number field, a left_button_ 
number field, and a right_button_number field respec- 
tively show button numbers of Buttons to receive the se- 
lected state when user operations of pressing the Move 
Down key, the Move Left key, and the Move Right key 



are performed while Button i is in the selected state. If 
any of these fields shows the button number of Button i, 
then a corresponding user operation is ignored. 
[0250] A start_object_id_normal field specifies a be- 
5 ginning one of object_ids that are serially assigned to a 
sequence of ODSs used to present the normal state of 
Button i in animation. 

[0251] An end_object_id_normal field specifies a last 
one of the object_ids that are serially assigned to the 

10 sequence of ODSs used to present the normal state of 
Button i in animation. If the end_object_id_normal field 
specifies the same I D as the start_object_id_normal field, 
a static image of a graphics Object identified by this ID 
is presented as Button i. 

15 [0252] A repeat_normal_flag field specifies whether 
the animation of Button i in the normal state is to be con- 
tinuously repeated. 

[0253] Astart_object_id_s elected field specifies a be- 
ginning one of object_ids that are serially assigned to a 
20 sequence of ODSs used to present the selected state of 
Button i in animation. 

[0254] An end_object_id_s elected field specifies a last 
one of the object_ids that are serially assigned to the 
sequence of ODSs used to present the selected state of 
25 Button i in animation. If the end_object_id_s elected field 
specifies the same ID as the start_object_id_s elected 
field, a static image of a graphics Object identified by this 
ID is presented as Button i. 

[0255] A repeat_selected_flag field specifies whether 
30 the animation of Button i in the selected state is to be 

continuously repeated. If the start_object_id_s elected 

field and the end_object_id_selected field have a same 

value, the re peat_s elected flag field is set to 00. 

[0256] A start_object_id_activated field specifies a be- 
35 ginning one of object_ids that are serially assigned to a 

sequence of ODSs used to present the activated state 

of Button i in animation. 

[0257] An end_object_id_activated field specifies a 
last one of the object_ids that are serially assigned to the 
40 sequence of ODSs used to present the activate state of 
Button i in animation. 

[0258] The following describes button commands. 
[0259] A button command (button_command) is a 
command that is executed when Button i is activated. 
45 The following commands (i) to (iv) are used as button 
commands, to write a value to a PSR or a GPR or read 
a value from a PSR or a GPR. 

(i) Get value of Player Status Register command 
50 (written as "Get value of Player Status Register (aug- 
ment)") 

This function acquires a value from a PSR specified 
by the augment. 

(ii) Set value of Player Status Register command 
55 (written as "Set value of Player Status Register (aug- 
ment 1 , augment 2) ") 

This function sets a value specified by augment 2, 
to a PSR specified by augment 1 . 
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(iii) Get valueof General Purpose Registercommand 
(written as "Get value of General Purpose Register 
(augment)") 

This function acquires a value from a GPR specified 
by the augment. 

(iv) Set value of General Purpose Registercommand 
(written as "Set value of General Purpose Register 
(augment 1 , augment 2)") 

This function sets a value specified by augment 2, 
to a GPR specified by augment 1 . 

<Specific Example> 

[0260] This concludes the description of the structure 
of the ICS. A specific example of interactive control by 
the ICS is given below. This specific example uses an 
ICS and ODSs shown in FIG. 36. FIG. 36 shows a rela- 
tionship between the ICS and the ODSs included in DSn. 
The ODSs are made up of ODS1 1 to ODS1 9, ODS21 to 
ODS29, ODS31 to ODS39, and ODS41 to ODS49. 
ODS11 to ODS19 represent each state of Button 1-A, 
ODS21 to ODS29 represent each state of Button 1 -B, 
ODS31 to ODS39 represent each state of Button 1 -C, 
and ODS41 to ODS49 represent each state of Button 1 - 
D, as indicated by the parenthesis "}" in the drawing. The 
ICS contains page information (1), (2), and (3) corre- 
sponding to three Pages 1 to 3. Status control of Buttons 
1-A to 1-D is defined in buttonjnfo (1), (2), (3), and (4) 
in page information (1 ) of Page 1 (as indicated by arrows 
bh1, bh2, bh3, and bh4 in the drawing). 
[0261] When timing of the control by the ICS matches 
presentation timing of picture data pt1 of a moving picture 
shown in FIG. 37, Page 1 out of the three Pages (Pages 
1 to 3) available for presentation by the ICS is overlaid 
on picture data pt1 and displayed (gs2). Thus, an Inter- 
active Display provided with a plurality of Buttons is pre- 
sented in correspondence with the contents of the mov- 
ing picture. In this way, realistic presentation using But- 
tons can be achieved through the use of an ICS. 
[0262] FIG. 39 shows an example of ICS description 
for defining status transitions of Buttons 1 -A to 1 -D shown 
in FIG. 38. Arrows hh1 and hh2 in FIG. 38 represent 
status transitions defined by neighbor_info() in button_ 
info(1), which is associated with Button 1-A. The lower_ 
button_number field in the neighbor_info() in buttonjnfo 
(1 ) is set to specify Button 1 -C. Accordingly, when a user 
operation of pressing the Move Down key is made while 
Button 1 -A is in the selected state (up1 in FIG. 38), Button 

1 -C receives the selected state (sj1 in FIG. 38). The right 

button number field in the neighboMnfo ( ) in button_ 

info (1 ) is set to specify Button 1 -B. Accordingly, when a 
user operation of pressing the Move Right key is made 
while Button 1-A is in the selected state (up2 in FIG. 38), 
Button 1-B receives the selected state (sj2 in FIG. 38). 
[0263] Arrow hh3 in FIG. 38 indicates control of astatus 
transition defined by neighboMnfo ( ) in buttonjnfo (3). 
The upperjDutton_n umber field in the neighborJnfo( ) 
in buttonjnfo (3), which is associated with Button 1-C, 



is set to specify Button 1-A. Accordingly, when a user 
operation of pressing the Move Up key is made while 
Button 1 -C is in the selected state (up3 in FIG. 38), Button 
1-A is put back to the selected state (sj 3 in FIG. 38). 
5 Button 1 -A corresponds to a button command "Set Page 
2". This command instructs the playback apparatus to 
switch to Page 2. Upon activation of Button 1 -A, this com- 
mand is executed, as a result of which Page 1 is switched 
to Page 2 as shown in FIG. 40. 

10 

<Playback Apparatus> 

[0264] This concludes the description of the improve- 
ments in the recording medium of the third embodiment. 

15 The following describes the playback apparatus of the 
third embodiment. Of the plurality of PSRs in the playback 
apparatus, PSR0, PSR11, and PSR10 relate to the in- 
teractive function. PSR0, PSR10, and PSR11 are ex- 
plained below, with reference to FIG. 41 . 

20 [0265] PSR0 specifies one of a plurality of IG streams 
which are listed as entries in the STN Jable of the current 
Playltem. 

[0266] PSR1 1 specifies, when the IG stream specified 
by PSR0 contains a plurality of Pages available for pres- 
25 entation, one of the plurality of Pages. 

[0267] PSR10 specifies, when the Page specified by 
PSR1 1 has a plurality of Buttons, one of the plurality of 
Buttons. 

[0268] To realize the interactive function, PSR0 makes 

30 the following status transitions. PSR0 is initially set at 1 , 
and can be set to any of the values 2 to 32 by the playback 
apparatus. FIG. 42A shows status transitions that can be 
made by PSR0. FIG. 42B is a flowchart of "Procedure 
when playback condition is changed" for PSR0. FIG. 43 

35 is a flowchart of "Procedure when change is requested" 
for PSR0. These status transitions and flowcharts are 
same as those of PSR1 and PSR2 described in the first 
embodiment. As in the case of audio streams and PG_ 
textST_streams, when IG streams corresponding to mul- 

40 tiple languages are multiplexed in the AV Clip, one of the 
IG streams that matches the language setting of the play- 
back apparatus is selected and played back. Here, the 
playback apparatus selects the IG stream depending on 
the order of entries in the STN Jable. Therefore, by ad- 

45 justing the order of entries in the STN Jable, the author 
can control which IG stream is to be selected. This con- 
cludes the description of the status transitions of PSR0. 
[0269] PSR10 and PSR1 1 make status transitions 
similar to those described in the first and second embod- 

50 iments, too. This will be described in detail later. 

[0270] The following describes a construction of the 
playback apparatus of the third embodiment. PSR0 spec- 
ifies the IG stream to be played. This being so, the control 
unit 24 and the Demultiplexer 3 perform the following 

55 processing. 

[0271] The control unit 24 extracts a PID from one of 
the entry-attribute combinations of IG streams in the 
STN Jable that is specified by PSR0, and sets the PID 
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in the Demultiplexer 3. 

[0272] The Demultiplexer 3 outputs, from among TS 
packets read from the BD-ROM and the HD, TS packets 
having the PI D set by the control unit 24, to the Interactive 
Graphics Decoder 13. Hence an ICS, a PDS, and an 5 
ODS are fed to the Interactive Graphics Decoder 13. 

<lnternal Construction of the Interactive Graphics De- 
coder 13> 

10 

[0273] An internal construction of the Interactive 
Graphics Decoder 13 is described below, with reference 
to FIG. 44. As shown in the drawing, the Interactive 
Graphics Decoder 13 includes a Coded Data Buffer 33, 
a Stream Graphics Processor 34, an Object Buffer 35, a 15 
Composition Buffer 36, and a Graphics Controller 37. 
[0274] The Coded Data Buffer 33 is a buffer for tem- 
porarily storing an ICS, a PDS, and an ODS together with 
DTSs and PTSs. 

[0275] The Stream Graphics Processor 34 decodes 20 
the ODS to obtain uncompressed graphics, and writes 
the uncompressed graphics to the Object Buffer 35. 
[0276] The Object Buffer 35 is a buffer for storing a 
plurality of sets of uncompressed graphics (represented 
by the rectangles in the drawing) generated by the 25 
Stream Graphics Processor 34. 

[0277] The Composition Buffer 36 is a memory for stor- 
ing an ICS. The Composition Buffer 36 outputs a plurality 
of sets of page information in the ICS and a plurality of 
button_info structures in each set of page information, to 30 
the Graphics Controller 37. 

[0278] The Graphics Controller 37 refers to each 
button_info structure in page information specified by 
PSR1 1 (current page information) out of the plurality of 
sets of page information in the ICS stored in the Compo- 35 
sition Buffer 36, and renders graphics. In detail, the 
Graphics Controller 37 reads graphics specified by a 
start_object_id_normal field value and an end_object_ 
id_normal field value of normal_state_info of each 
button_info structure in the current page information from 40 
the Object Buffer 35, and writes the read graphics to the 
Interactive Graphics Plane 15. Regarding aton_in struc- 
ture specified by PSR10, the Graphics Controller 37 
reads graphics specified by a start_object_id_selected 
field value and an end_object_id_selected field value of 45 
selected_state_info of the button_info structure from the 
Object Buffer 35, and writes the read graphics to the In- 
teractive Graphics Plane 15. Arrows bg1, bg2, bg3, and 
bg4 in FIG. 44 represent the rendering of the graphics 
by the Graphics Controller 37. As a result of the render- 50 
ing, a Page including Buttons 1 -A to 1 -D is stored on the 
Interactive Graphics Plane 15 and overlaid on a moving 
picture. 

[0279] This concludes the rough description of the pro- 
cedure to be performed by the Graphics Controller 37. 55 
FIGS. 45 to 51 show the procedure to be performed by 
the Graphics Controller 37 in greater detail. 
[0280] FIG. 45 is a flowchart of a main routine of the 



procedure performed by the Graphics Controller 37. In 
this flowchart, while conducting step S88 (an animation 
procedure) and step S89 (an UO procedure), judgments 
are made in steps S81 , S82, and S83 as to whether spe- 
cific events have occurred. If any of the events has oc- 
curred, corresponding steps are performed and the pro- 
cedure returns to the main routine. 
[0281] A judgment is made as to whether the current 
playback time has reached a point when the ICS be- 
comes valid (S81). If the judgment in step S81 is YES, 
PSR1 0 is set to specify first page information in the ICS 
(S84). After this, a current page display procedure is car- 
ried out (S85). 

[0282] A judgment is made as to whether the current 
playback time has reached a point shown by the 
selection_time_out_pts (S82). lfthejudgmentinstepS82 
is YES, a button activation procedure is carried out (S86). 
[0283] A judgment is made as to whether the current 
playback time has reached a point shown by the 
composition_time_out_pts (S83). If the judgment in step 
S83 is YES, the Interactive Graphics Plane 1 5 is cleared 
and PSR10 and PSR11 are changed to Invalid (S87). 
This completes the synchronization procedure using time 
stamps. In this synchronization procedure, steps S85 and 
S86 are performed by calling subroutines. A procedure 
of the subroutine of step S85 is described below, with 
reference to FIG. 46. 

[0284] FIG. 46 is a flowchart of an initial display pro- 
cedure. A display effect specified by the in_effects field 
of the current page information is executed (S91). After 
this, a current button setting procedure is performed 
(S92). The current Button is specified by PSR1 0. Accord- 
ingly, "Procedure when playback condition is changed" 
for PSR1 0 is performed to determine the current Button. 
Once the current Button has been determined as a result 
of step S92, the procedure advances to steps S93 to S98. 
[0285] Steps S93 to S98 form a loop that is performed 
for each button_info structure in the current Page (S93 
and S94). Button-info to be processed in this loop is called 
button_info (p). 

[0286] A judgment is made as to whether button_info 
(p) corresponds to the current Button (S95). If the judg- 
ment in step S95 is YES, the procedure advances to step 
S96. If the judgment in step S95 is NO, the procedure 
advances to step S97. 

[0287] In step S96, a graphics Object specified by a 
start_object_id_selected field value of selected_state_ 
info in button_info (p) is designated as graphics Obj ect 
(p) in the Object Buffer 35. 

[0288] In step S97, a graphics Object specified by a 
start_object_id_normal field value of normal_state_info 
in button_info(p) is designated as graphics Object(p) in 
the Object Buffer 35. 

[0289] Once graphics Object (p) has been designated 
as a result of step S96 or S97, graphics Object(p) is writ- 
ten onto the Interactive Graphics Plane 15 at a position 
specified by a button_horizontal_position field value and 
a button_vertical_position field value in button_info (p) 
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(S98). As a result of performing this operation for each 
button_info structure in the current Page, among a plu- 
rality of graphics Obj cts associated with each button 
state, an initial graphics Object is rendered for each But- 
ton to the Interactive Graphics Plane 15. 
[0290] A procedure of the subroutine of step S86 is 
explained next, with reference to FIG. 47. 
[0291] FIG. 47 is a flowchart of a button auto-activation 
procedure. A judgment is made as to whether a defauit_ 
activated_button_id_ref is 00 or FF (S1 00). If the default 
activated_button_id ref is 00, the procedure returns to the 
main routine without performing any step. If the default_ 
activated_button_id_ref is FF, current Button i is activat- 
ed (S102). Following this, variable animation(i) corre- 
sponding to current Button i is set to 0. The procedure 
then returns to the main routine (S103). 
[0292] If the default activated button id ref is neither 00 
nor FF, a Button specified by the default_activated_ 
button_id_ref is set as current Button i (S101), and cur- 
rent Button i is activated (S1 02). Following this, animation 
(i) corresponding to current Button i is set to 0. The pro- 
cedure then returns to the main routine (S103). 
[0293] As a result of the above procedure, a Button in 
the selected state is activated after a predetermined time 
period. This concludes the description of the flowchart of 
FIG. 47. 

[0294] The following describes a procedure of anima- 
tion display on a Page. FIG. 48 is a flowchart of the an- 
imation display procedure. 

[0295] The initial display is presented by writing the 
graphics Object specified by the start_object_id_normal 
in the normal_state_info or the start_object_id_selected 
in the selected_state_info in each button_info structure, 
onto the Interactive Graphics Plane 15. Animation means 
an operation of updating each Button image by overwrit- 
ing the Interactive Graphics plane 15 with an arbitrary 
one of a sequence of graphics Objects (qth graphics Ob- 
ject) associated with the Button, in each repetition of the 
main routine. That is to say, each Button is presented in 
animation by rendering a sequence of graphics Objects 
associated with the normal_state_info or selected_ 
state_info provided within each button_info structure, 
one by one to the Interactive Graphics Plane 15. Here, 
variable q is used to specify an individual graphics Object 
associated with the normal_state_info or selected_ 
state_info provided within each button_info structure. 
[0296] The animation display procedure is described 
below, by referring to FIG. 48. For simplicity' s sake, this 
flowchart is based on a premise that the repeat_normal_ 
flag and the repeat_selected_flag in each button_info 
structure in the ICS are set to indicate that the continuous 
repetition is required. 

[0297] A judgment is made as to whether the initial 
display has been performed (S1 10) If the initial display 
is not yet performed, the procedure returns to the main 
routine without performing any step. If the initial display 
has been performed, the procedure advances to steps 
S1 1 1 to S123. Steps S11 1 to S123 form a loop in which 



steps S1 13 to S123 are performed for each button_info 
structure (button_info(p)) of the current page information 
in the ICS (S111 and S112). 

[0298] Variable q is set to the value of animation(p) 
5 corresponding to button_info(p) (S1 1 3). As a result, var- 
iable q represents the current frame number for button_ 
info (p). 

[0299] A judgment is made as to whether button_info 
(p) corresponds to the current Button, i.e. the Button 
10 which is currently in the selected state (S1 14). 

[0300] If the judgment in step S1 44 is NO, a value ob- 
tained by adding variable q to the start_object_id_normal 
of the normal_state _info in button_info (p) is set as ID 
(q)(S115). 

15 [0301] If the judgment in step S1 14 is YES, the proce- 
dure advances to step S1 1 6. 

[0302] In step S1 16, a judgment is made as to whether 
the current Button is in the activated state. If the current 
button is in the activated state, a value obtained by adding 
20 variable q to the start_object_id_activated of the 
actioned_state_info in button_info(p) is set as ID(q) 
(S117). After this, one of button commands in button_ 
info(p) is executed (S1 18). 

[0303] If the current Button is not in the activated state, 
25 a value obtained by adding variable q to the start_object_ 
id_selected of the selected_state_info in button_info (p) 
is set as ID(q) (S119). 

[0304] Once ID(q) has been determined in this way, 
graphics Object (q) identified by ID (q) is read from the 
30 Object Buffer 35 and written to the Interactive Graphics 
Plane 15 at a position shown by the button_horizontal_ 
position and the button_vertical_position in button_info 
(P) (S120). 

[0305] As a result, the qth graphics Object in the se- 

35 quence of graphics Objects representing the selected 
state (or the activated state) of the current Button or the 
normal state of any of the other Buttons in animation is 
obtained on the Interactive Graphics Plane 15. 
[0306] A judgment is made as to whether the sum of 

40 the start_object_id_normal and variable q has reached 
the end_object_id_normal in button_info (p) (S121). If 
the judgment in step S1 21 is NO, variable q is increment- 
ed by 1 and assigned to animation(p) (S1 22). If the judg- 
ment in step S121 is YES, animation(p) is initialized to 0 

45 (S123). The above operation is repeated for each button 
info structure of the current page information in the ICS 
(S1 1 1 and S1 22). Once the operation has been complet- 
ed for all button_info structures, the procedure returns to 
the main routine. 

50 [0307] As a result of steps S1 1 0 to S1 23, each Button 
image on the Interactive Display is updated using a new 
graphics Object each time the main routine is performed. 
Repeating the main routine over and over again enables 
the Button images to be presented in animation. When 

55 presenting the Buttons in animation, the Graphics Con- 
troller 37 adjusts the duration for presenting each graph- 
ics Object so as to maintain the animation frame rate 
code. 
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[0308] A button command execution procedure is ex- 
plained below, with reference to a flowchart of FIG. 49. 
One button_command is extracted from in the button_ 
info (S131). A judgment is made as to whether the 
button_command is a Page switching command (S1 32). 5 
If the button_command is not a Page switching com- 
mand, the button_command is executed (S133). If the 
button_command is a Page switching command, a dis- 
play effect specified by the out_effects in the current Page 
is executed (S134). Following this, a switching destina- 10 
tion page number specified by an operand of the button_ 
command is set as X, and a button number specified by 
an operand of the button_command is set in PSR10 
(S135). After this, "Procedure when change is requested" 
for PSR1 1 is performed (S1 36). PSR1 1 specifies the cur- 15 
rent Page. By performing "Procedure when change is 
requested" for such PSR11, the current Page is deter- 
mined. After this, "Procedure when playback condition is 
changed" is performed for PSR10. This completes the 
button command execution procedure. 20 
[0309] This concludes the description of the button 
command execution procedure. The following describes 
an UO procedure in step S89 of the main routine, with 
reference to FIG. 50. 

[0310] FIG. 50 is a flowchart of the UO procedure. In 25 
this flowchart, steps S1 40 to S1 43 are performed to judge 
whether specific events have occurred. If any of the 
events has occurred, corresponding steps are performed 
and then the procedure returns to the main routine. A 
judgment is made as to whether the UO_mask_table in 30 
the current Page is set to 1 (S140). If the judgment in 
step S140 is YES, the procedure returns to the main rou- 
tine without performing any step. 

[0311] A judgment is made as to whether any of the 
Move Up key, the Move Down key, the Move Left key, 35 
and the Move Right key has been pressed (S1 41 ). If the 
judgment in step S141 is YES, a current Button change 
procedure is performed (S147), and a judgment is made 
as to whether the auto_action_flag of the current Button 
is 01 (S148). If the judgment in step S148 is NO, the 40 
procedure returns to the main routine. If the judgment in 
step S1 48 is YES, the procedure advances to step S 144. 
[0312] A judgment is made as to whether a numeric 
input has beenmade (S243). If the numeric input has 
been made, a numeric input operation is performed 45 
(S246). After this, the procedure returns to the main rou- 
tine. 

[0313] A judgment is made as to whether the Activated 
key has been pressed (S142). If the judgment in step 
S142 is YES, current Button i is activated (S144). After 50 
this, animation (i) is set to 0 (S145). In the procedure 
shown in FIG. 50, step S147 is performed by calling a 
subroutine. FIG. 51 shows a procedure of this subroutine. 
[0314] FIG. 51 is a flowchart of a current button change 
procedure. First, from the upper_button_number, the 55 
lower_button_number, the left_button_number, and the 
rig ht_button_n umber in the neighboMnfo associated 
with the current Button, a button number that corre- 



sponds to the pressed key is specified (S150). 

[031 5] The current Button is set as button Y, and a new 

Button identified by the specified button number is set as 

Button X (S151). To set PSR10 to X, "Procedure when 

change is requested" is performed (S152). 

[0316] After the setting, animation (X) and animation 

(Y) are set to 0. The procedure then returns to the main 

routine (S153). 

[0317] This concludes the description of the proce- 
dures performed by the Interactive Graphics Decoder 1 3. 

<Specific Examples of Focus Shift> 

[0318] In the above Page switching, theauthordecides 
which Button in the switch destination Page is to be set 
in the selected state. This raises an issue of how to per- 
form a focus shift. A focus referred to here indicates a 
Button which is in the selected state. A focus shift is to 
dynamically or statically change the Button in the select- 
ed state in accordance with Page switching, using the 
aforementioned button command or default selected but- 
ton. 

[0319] The following describes a focus shift for aiding 
the viewing of a package medium on which a plurality of 
sets of content such as a drama series are recorded. In 
the package medium recording the drama series, content 
corresponding to each of the episodes such as the first 
to fourth episodes is contained in one disc. In this case, 
playback is generally performed in the order of episodes, 
i.e. the first episode — » the second episode the third 
episode the fourth episode. This being so, it is trou- 
blesome for the user to perform, on a selection menu, an 
operation of selecting the next episode each time play- 
back of one episode ends. 

[0320] FIG. 52 shows a specific example of this selec- 
tion operation. In the drawing, the selection menu has 
Buttons corresponding to the first to fourth episodes. 
When the selection of one Button is confirmed, a chapter 
menu for an episode corresponding to that Button is dis- 
played. After the display of the chapter menu, the selec- 
tion menu is displayed again. On this selection menu, 
the user needs to perform a key operation to select the 
next episode. In detail, when a chapter menu of the first 
episode is displayed (hw1 ) and then the selection menu 
is displayed again (hw2), the user needs to perform a 
key operation (ks1) to select the second episode. 
[0321] Also, when a chapter menu of the second epi- 
sode is displayed (hw3) and then the selection menu is 
displayed again (hw4), the user needs to perform a key 
operation (ks2) to select the third episode. 
[0322] A focus shift alleviates such a trouble of having 
to perform key operations. The following describes a pro- 
cedure of performing a focus shift. FIG. 53 shows how 
Pages 1 to 4 shown in FIG. 52 are assigned to the se- 
lection menu and the chapter menus. Here, Page 1 is 
assigned to the selection menu, Page 2 is assigned to 
the chapter menu of the first episode, Page 3 is assigned 
to the chapter menu of the second episode, and Page 4 
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is assigned to the chapter menu of the third episode. 
[0323] Also, Buttons 1 -A to 1 -D on Page 1 are assigned 
respectively to selection Buttons for the first to fourth ep- 
isodes in the selection menu, and Buttons 2-A to 2-F on 
Page 2 are assigned respectively to selection Buttons 5 
for chapters 1 to 5 and a return Button in the chapter 
menu of the first episode. The return Button referred to 
here is a Button for accepting a user operation of display- 
ing the selection menu again. 

[0324] This being the case, button commands of But- 10 
ton 1-A on Page 1 and button commands of Button 2-F 
on Page 2 define procedures such as those shown in 
FIG. 54 . Procedures defined by the button commands 
of Button 1-A are the following. When the selection of 
Button 1 -A is confirmed, (1 ) the value of PSR1 0 is saved 15 
to a GPR, (2) PSR11 is set to 2, and (3) PSR1 0 is set to 1 . 
[0325] By setting the PSRs in this way, the chapter 
menu of the first episode is displayed with Button 2-A 
being in the selected state. 

[0326] Meanwhile, procedures defined by the button 20 
commands of Button 2-F are the following. When the 
selection of Button 2-F is confirmed, (1 ) PSR1 1 is set to 
1 , and (2) PSR1 0 is set to a sum of 1 and the value saved 
to the GPR. 

[0327] According to these procedures defined by the 25 
button commands of Button 1-A on Page 1 and Button 
2-F on Page 2, when the display of the chapter menu of 
the first episode ends and the selection menu is displayed 
again, the focus is automatically shifted from the Button 
for the first episode to the Button for the second episode 30 
on the selection menu. By defining button commands of 
Buttons 1 -B to 1 -D on Page 1 and the Buttons of the other 
Pages in a similar way, focus shifts such as those shown 
in FIG. 55 can be realized. 

[0328] With the aid of such focus shifts, the user can 35 
easily search the drama series made up of a number of 
sets of content, for a chapter which he or she wants to 
view. 

[0329] To realize the above focus shifts, it is necessary 
to define button commands for each individual Button. 40 
This being so, if there are many Pages and Buttons, a 
bug may occur. This raises the need for conducting a 
test to find bugs. 

[0330] Bugs likely to occur in focus shifts are as follows. 
When displaying Page 1, if the above procedures are 45 
performed while Button 1-D is in the selected state, a 
button number (= 5) obtained by adding 1 to a button 
number of Button 1-D is written to PSR10 upon switching 
from Page 1 , Page 2, and back to Page 1 . Since Page 1 
does not have a fifth Button, the focus will end up being 50 
shifted to a nonexistent Button on Page 1 . Also, there 
may be a case where after the sixth Button (Button 1 -F) 
on Page 2 is set in the selected state, Page 1 is displayed 
again without updating PSR10, as shown in FIG. 56. In 
this case too, the focus will end up being shifted to a 55 
nonexistent Button on Page 1. Thus, when the number 
of Buttons on each Page is different, a bug of putting a 
nonexistent Button on a switch destination Page into the 



selected state can occur frequently. Such defects need 
be corrected upon shipment of content. Accordingly, the 
author must perform a debug test to ensure normal op- 
erations, as in the case of shipment of programs. How- 
ever, the imperative for the author to perform such a de- 
bug test as being conducted by a software house may 
adversely affect the content production that is the core 
business of the author. 

[0331] In view of this, the third embodiment of the 
present invention applies status transitions through "Pro- 
cedure when playback condition is changed" and "Pro- 
cedure when change is requested", to PSR10 and 
PSR1 1 in the same way as PSR1 , PSR2, and PSR3. 

<Status transitions of PSR1 1 > 

[0332] PSR1 1 specifies a Page which is currently dis- 
played among a plurality of Pages included in the IG 
stream (current Page) . PSR1 1 takes one of the values 
00 to FF, and the playback apparatus displays the Page 
specified by PSR1 1 . FIG. 57A shows status transitions 
that can be made by PSR1 1 . When comparing this draw- 
ing with FIG. 15A, it can be seen that there is no status 
transition triggered by the "Cross a Playltem boundary" 
event. Also, an event that triggers a status transition from 
Invalid to Valid has been changed from "Start PlayList 
playback" to "Interactive Composition Segmentbecomes 
Valid", and an event that triggers a status transition from 
Valid to Invalid has been changed from "Terminate Play- 
List playback" to "Interactive Composition Segment be- 
comes Invalid". Also, "Procedure when change is re- 
quested" has been changed from "stream change is re- 
quested" to "page change is requested. Apart from these 
differences, FIG. 57A is same as FIG. 15A. 
[0333] "Interactive Composition Segment becomes 
Invalid" includes an event that the current playback time 
has reached a point specified by the composition_time_ 
out_pts in an ICS, an event that an ICS has changed, 
and an event that PlayList playback ends. The number 
of audio streams differs for each Playltem. Accordingly, 
when PlayList playback starts and each time a Playltem 
boundary is crossed, "Procedure when playback condi- 
tion is changed" needs to be performed to set PSR1. 
However, PSR11 is used only in a playback section 
where an ICS is multiplexed, and so there is no need to 
perform "Procedure when playback condition is 
changed" each time a Playltem boundary is crossed. 
Therefore, a status transition from Invalid to Valid of 
PSR11 is triggered by an event that an ICS becomes 
Valid. 

[0334] "Procedure when playback condition is 
changed" for PSR11 is explained below. FIG. 57B is a 
flowchart of "Procedure when playback condition is 
changed" for PSR1 1 . In "Procedure when playback con- 
dition is changed", first page information in the ICS is set 
in PSR11 (S154). 

[0335] FIG. 57C is a flowchart of "Procedure when 
change is requested" for PSR1 1 . A judgment is made as 
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to whether X is Valid (S155). If X is Valid, X is assigned 
to PSR1 1 (S156). If X is Invalid, the value of PSR1 1 is 
maintained (S157). This concludes the description of 
PSR11. 

<Status Transitions of PSR10> 



below. The invention of each of the claims of this appli- 
cation includes extension and generalization of the above 
embodiments and their modifications below. The degree 
of extension and generalization depends upon the state 
5 of the art in the technical field of the present invention at 
the time of filing of this application. 



[0336] The following describes status transitions of 
PSR10. FIG. 58A shows status transitions that can be 
made by PSR1 0. This drawing is same as FIG. 57A, ex- 10 
cept that a status transition triggered by an event 
"Change Page" or "Button Disabled" has been added. 
Also, "Procedure when change is requested" has been 
changed from "page change is requested" to "button 
change is requested". is 
[0337] "Change Page" is an event that Page switching 
is requested. "Button Disabled" is an event that a Button 
displayed on a Page is disabled. Upon the occurrence 
of such an event, "Procedure when playback condition 
is changed" is performed to set PSR1 0, and then PSR10 20 
returns to Valid. 

[0338] "Procedure when playback condition is 
changed" and "Procedure when change is requested" for 
PSR10 are described below. 

[0339] FIG. 58B is a flowchart of "Procedure when 25 
playback condition is changed" for PSR10. 
[0340] A judgment is made as to whether the default_ 
selected_button_id_ref in the current Page is Valid 
(S161). If the judgment in step S161 is YES, PSR10 is 
set to the default_selected_button_id_ref (S1 62). 30 
[0341 ] If the judgment in step S1 61 is NO, a judgment 
is made as to whether PSR1 0 is Valid (S1 63). If PSR1 0 
is Valid, the value of PSR10 is maintained (S164). If 
PSR10 is Invalid, PSR10 is set to a button number of the 
first button_info structure in the current Page (S1 65). 35 
[0342] FIG. 59 is a flowchart of "Procedure when 
change is requested" for PSR10. First, a judgment is 
made as to whether X is Valid (S1 66). If X is Valid, PSR1 0 
is set to X (S168). If X is Invalid, the value of PSR10 is 
maintained (S167). *o 
[0343] According to the above procedures, when 
PSR1 0 is Invalid, PSR1 0 is set so that the Button spec- 
ified by the first button_info structure of the current Page 
is set in the selected state. Accordingly, even if the author 
designates a button number of a Button which does not 45 
exist in a switch destination Page, a process of changing 
the wrong button number to a correct button number is 
automatically performed. Thus, even if a button com- 
mand for realizing a focus shift has a defect, such a defect 
can be automatically corrected. This reduces the burden 50 
on the author. 

Modifications 

[0344] Though the present invention has been de- 55 
scribed by way of the above embodiments, the present 
invention is not limited to such. The present invention 
can be realized with any of modifications (A) to (M) given 



(A) The above embodiments describe the case 
where the BD-ROM is used as the recording medium 
according to the present invention. Main features of 
the present invention, however, lie in a graphics 
stream recorded on the recording medium, which 
does not rely on physical characteristics of BD- 
ROMs. Therefore, the present invention is applicable 
to any recording medium that is capable of recording 
a graphics stream. Examples of such a recording 
medium include: an optical disc such as a DVD- 
ROM, a DVD-RAM, a DVD-RW, a DVD-R, a 
DVD+RW, a DVD+R, a CD-R, or a CD-RW; a mag- 
neto-optical disk such as a PD or an MO; a semicon- 
ductor memory card such as a CompactFlash card, 
a SmartMedia card, a Memory Stick card, a Multi- 
MediaCard, or a PCMCIAcard; a magneticdisksuch 
as a flexible disk, SuperDisk, Zip, or Clik!; a remov- 
able hard diskdrive such as ORB, Jaz, SparQ, SyJet, 
EZFley, or Microdrive, and a nonremovable hard disk 
drive. 

(B) The above embodiments describe the case 
where the playback apparatus decodes an AV Clip 
on the BD-ROM and outputs the decoded AV Clip 
to the television. As an alternative, the playback ap- 
paratus may be equipped with only a BD-ROM drive, 
with the remaining construction elements being pro- 
vided in the television. In this case, the playback ap- 
paratus and the television can be incorporated in a 
home network connected with an IEEE 1394 con- 
nector. The above embodiments describe the case 
where the playback apparatus is connected to the 
television, but the playback apparatus may instead 
be integrated with a display device. Also, the play- 
back apparatus may include only the system LSI (in- 
tegrated circuit) which constitutes an essential part 
of processing. The playback apparatus and the in- 
tegrated circuit are both an invention described in 
this specification. Accordingly, regardless of whether 
the playback apparatus or the integrated circuit is 
concerned, an act of manufacturing a playback ap- 
paratus based on the internal construction of the 
playback apparatus described in the first embodi- 
ment is an act of working of the present invention. 
Also, any act of assigning with charge (i.e. for sale) 
or without charge (i.e. as a gift), leasing, and import- 
ing the playback apparatus is an act of working of 
the present invention. Likewise, an act of offering for 
assignmentor lease of the playback apparatus using 
storefront displays, catalogs, or brochures is an act 
of working of the present invention. 

(C) Information processing using the programs 
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shown in the flowcharts is actually realized using 
hardware resources. Accordingly, the programs 
which describe the operational procedures shown in 
the flowcharts are themselves an invention. The 
above embodiments describe the case where the 5 
programs are incorporated in the playback appara- 
tus, but the programs can be used independently of 
the playback apparatus. Acts of working of the pro- 
grams include (1 ) an act of manufacturing, (2) an act 
of assigning with or without charge, (3) an act of leas- 10 
ing, (4) an act of importing, (5) an act of providing to 
the public via a bi-directional electronic communica- 
tions network, and (6) an act of offering for assign- 
ment or lease using storefront displays, catalogs, or 
brochures. is 

(D) The time elements of the steps which are exe- 
cuted in a time series in each of the flowcharts can 
be regarded as the necessary elements of the 
present invention. This being so, a playbackmethod 
shown by these flowcharts is an invention. If the 20 
processing shown in each flowchart is carried out by 
performing the steps in a time series so as to achieve 

the intended aim and the intended effect, this is an 
act of working of the recording method of the present 
invention. 25 

(E) When recording an AV Clip on the BD-ROM, an 
extension header may be added to each TS packet 
in the AV Clip. The extension header is called a TP_ 
extra_header, includes an arrival_time_stamp and 

a copy_permission_indicator, and has a data length 30 
of 4 bytes. TS packets with TP_extra_headers (here- 
after "EX TS packets") are grouped in units of 32 
packets, and each group is written to three sectors. 
One group made up of 32 EX TS packets has 6,144 
bytes (= 32x192), which is equivalent to a size of 35 
three sectors that is 61 44 bytes (= 2048X3). The 32 
EX TS packets contained in the three sectors are 
called an Aligned Unit. 

In a home network connected with an IEEE 1394 
connector, the playback apparatus transmits an 40 
Aligned Unit in the following manner. The playback 
apparatus removes a TP_extra_header from each 
of the 32 EXTS packets in the Aligned Unit, encrypts 
the body of each TS packet according to the DTCP 
Specification, and outputs the encrypted TS packets. 45 
When outputting the TS packets, the playback ap- 
paratus inserts an isochronous packet between ad- 
jacent TS packets. A pos ition where the isochronous 
packet is inserted is based on a time shown by an 
arrival_time_stamp of the TP_extra_header. The 50 
playback apparatus outputs a DTCP_descriptor, as 
well as the TS packets. The DTCP_descriptor cor- 
responds to a copy_permission_indicator in the TP_ 
extra_header. With the provision of the DTCP_de- 
scriptor indicating"copyprohibited", it is possible to 55 
prevent, when using the TS packets in the home net- 
work connected with the IEEE 1394 connector, the 
TS packets from being recorded to other devices. 



(F) The above embodiments describe the case 
where an AV Clip of the Blu-ray Disc Read-Only For- 
mat is used as a digital stream, but the present in- 
vention can also be realized with a VOB (Video Ob- 
ject) of the DVD-Video Format or the DVD-Video Re- 
cording Format. The VOB is a program stream that 
complies with the ISO/IEC 1 381 8-1 Standard and is 
obtained by multiplexing a video stream and an audio 
stream. Also, the video stream in the AV Clip may 
be an MPEG4 video stream or a WMV video stream. 
Further, the audio stream in the AV Clip may be a 
Linear PCM audio stream, an MP3 audio stream, or 
an MPEG-AAC audio stream. 

(G) The movie content described in the above em- 
bodiments may be obtained by encoding an analog 
image signal broadcast by analog broadcasting. Al- 
so, the movie content may be stream data made up 
of a transport stream broadcast by digital broadcast- 
ing. 

Alternatively, an analog/digital image signal record- 
ed on a videotape may be encoded to obtain content. 
Also, an analog/digital image signal directly captured 
by a video camera may be encoded to obtain content. 
A digital work distributed by a distribution server is 
applicable too. 

(H) Graphics Objects described in the above embod- 
iments is run-length encoded raster data. Run-length 
encoding is used for compression/encoding of 
graphics Objects, because the run-length encoding 
is most suitable for compression and decompression 
ofsubtitles. Subtitles have a property in that a con- 
tinuous length of the same pixel value in a horizontal 
direction is relatively long. Therefore, by performing 
compression using run-length encoding, a high com- 
pression rate can be attained. In addition, run-length 
encoding reduces a load for decompression, and is 
therefore suitable for realizing decoding by software. 
For the purpose of providing a decoding construction 
common to subtitles and Buttons, the compression 
and decompression method used for subtitles is also 
employed for Buttons. Nevertheless, the use of run- 
length encoding for graphics Objects is not a limita- 
tion of the present invention. For example, graphics 
Objects may be PNG data. Also, graphics Objects 
may be vector data instead of raster data. Further, 
graphics Objects may be transparent patterns. 

(I) Subtitle graphics selected according to a display 
setting of the playback apparatus may be subjected 
to display effects of PCSs. For example, graphics of 
various display modes such as wide screen, pan and 
scan, and letterbox are recorded on the BD-ROM, 
and the playback apparatus selects one of these dis- 
play modes according to a display setting of the tel- 
evision connected with the playback apparatus and 
displays corresponding graphics. Since the display 
effects of PCSs are applied to such subtitle graphics, 
viewability increases. As a result, display effects 
achieved by using characters which are contained 
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within the body of video can be realized with subtitle 
graphics displayed according to the display setting. 
This contributes to high practicality. 
(J) The above embodiments describe the case 
where the playback apparatus includes a Graphics 5 
Plane. Alternatively, the playback apparatus may in- 
clude a line buffer for storing uncompressed pixels 
of one line. Since conversion to an image signal is 
performed for each horizontal row (line), conversion 
to an image signal can equally be performed with 10 
the line buffer. 

(K) The third embodiment describes the case where 
button commands for setting PSR1 0 and PSR1 1 are 
written in an ICS, but button commands for setting 
PSR1 , PSR2, and PSR3 may be written in the ICS 15 
too. For example, if PSR2 specifies English subtitles, 
button commands for selecting Japanese subtitles 
may be provided. 

(L) A default Button may be provided on each of an 
audio selectionmenu and a subtitle selectionmenu 20 
used for receiving an audio stream selection and a 
subtitle stream selection. Button information corre- 
sponding to such a default Button has button com- 
mands for setting PSR1 or PSR2 to an undefined 
value. If the default Button is activated and these 25 
button commands are executed, PSR1 or PSR2 is 
set to the undefined value, and "Procedure when 
playback condition is changed" is performed to se- 
lect an optimal audio stream or PG_textST_stream. 
(M) The first embodiment describes the case where 30 
the three conditions (a) to (c) are used, but the 
number of conditions may be four or more. 



[0345] According to an embodiment, a playback meth- 
od of playing back a digital stream generated by multi- 35 
plexing a plurality of elementary streams is provided. The 
playback method comprises the step of judging, for each 
elementary stream, which of a plurality of predetermined 
conditions the elementary stream satisfies. The method 
further comprises the step of assigning a priority to each 40 
elementary stream according to a pattern of conditions 
the elementary screen satisfies, and selecting and play- 
ing back the highest-priority elementary stream. The 
method can be implemented as a computer-readable 
program used for enabling a computer to perform the 45 
steps of the method. 

[0346] According to a further embodiment, a playback 
apparatus for playing back a digital stream generated by 
multiplexing aplurality of elementary streams is provided. 
The playback apparatus comprises a judgment unit op- so 
erable to judge for each elementary stream, which of a 
plurality of predetermined conditions the elementary 
stream satisfies and a playback unit operable to assign 
a priority to each elementary stream according to a pat- 
tern of conditions the elementary stream satisfies, and 55 
select and play back the highest-priority elementary 
stream. 

[0347] Preferably, the playback unit assigns a higher 



priority to the elementary stream if the elementary stream 
satisfies more conditions. 

[0348] Preferably, in a playback apparatus in accord- 
ance with the aforesaid embodiment, the plurality of pre- 
determined conditions include a first condition, a second 
condition, and a third condition. In the conditions, the first 
condition is that the playback apparatus has a capability 
of playing back the elementary stream. The second con- 
dition is that a language attribute of the elementary 
stream matches a language setting of the playback ap- 
paratus. The third condition is that a general attribute of 
the elementary stream is surround sound and the play- 
back apparatus has a surround output capability. In a 
preferred embodiment, the playback unit assigns a high- 
er priority to the elementary stream if the elementary 
stream satisfies the first condition and the second con- 
dition than if the elementary stream satisfies the first con- 
dition and the third condition. 

[0349] In another version of the aforesaid embodiment 
of the playback apparatus, additionally a status register 
is included in the playback apparatus and the playback 
unit performs the selection by setting a stream number 
of the highest-priority elementary stream in the status 
register. More preferably, a plurality of sets of playback 
section information are recorded on a recording medium. 
The judgment by the judgment unit and the selection by 
the playback unit are preformed when played back ac- 
cording to one of the plurality of sets of playback section 
information begins. The status register is set to be invalid 
when the playback according to the set of playback sec- 
tion information ends. Also preferably, the playback ap- 
paratus further comprises an acquisition unit operable to 
acquire a switching destination stream number when a 
stream switching request is made and a setting unit op- 
erable to set the switching destination stream number in 
the status register if the switching destination stream 
number is valid. If the switching destination stream 
number is invalid, the set value of the status register is 
maintained. The judgment by the judgment unit and the 
selection by the playback unit are performed if the switch- 
ing destination stream number is a predetermined unde- 
fined value. Still more preferably, the playback apparatus 
further comprises a reception unit operable to receive a 
user operation. The acquisition unit acquires the switch- 
ing destination stream number based on the user oper- 
ation received by the reception unit. Also preferably, the 
playback apparatus further comprises an execution unit 
operable to execute a command recorded on a recording 
medium. In the respective version, the acquisition unit 
acquires the switching destination stream number based 
on the command executed by the execution unit. Also 
preferably, the switching destination stream number is 
invalid if the switching destination stream number ex- 
ceeds the number of entries in a predetermined table. 
[0350] In another variation of the playback apparatus 
having the status register, further a setting unit for setting 
a predetermined undefined value in the status register, 
when a recording medium is loaded to the playback ap- 
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paratus is included. The judgment by the judgment unit 
and the selection by the playback unit are performed if a 
set value of the status register is the predetermined un- 
defined value 

Industrial Applicability 

[0351] The above embodiments disclose the internal 
construction of the playback apparatus to which the 
present invention relates, and the playback apparatus 
can be manufactured in volume based on the disclosed 
internal construction. In other words, the playback appa- 
ratus are capable of being industrially used. Hence the 
playback apparatus has industrial applicability. 

Numerical References 

[0352] 

1 BD drive 

2 Read Buffer 

3 Demultiplexer 

4 Video Decoder 

5 Video Plane 

9 Presentation Graphics Decoder 

10 Presentation Graphics Plane 

1 1 adder 

12 Font Generator 

13 Interactive Graphics Decoder 

1 4 switch 

15 Interactive Graphics Plane 

1 6 adder 

17 Controller 

1 8 Read Buffer 

19 Demultiplexer 

20 Audio Decoder 

21 switch 

22 switch 

23 scenario memory 
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control unit 
switch 
CLUT unit 
CLUT unit 
PSR set 

operation reception unit 
transition control unit 
playback apparatus 
television 
remote control 
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Claims 



1. A playback apparatus for playing back a video 
25 stream and an audio stream in accordance with play- 
list information recorded on a recording medium, the 
playback apparatus characterized by comprising: 

a configuration register operable to indicate, for 
30 each encoding method, a configuration pertain- 

ing to whether surround audio can be output; 
a language setting register operable to indicate 
a language setting in the playback apparatus; 
a stream number register operable to store a 
35 stream number of an audio stream to be played 

back; 

a control unit operable to select one of a plurality 
of audio streams by executing a predetermined 
procedure; and 
40 a playback unit operable to play back the select- 

ed audio stream along with the video stream, 
wherein 

the recording medium includes a read-only op- 
tical disk and a supplementary recording medi- 

45 um, 

the playlist information includes one or more 
pieces of playback section information, the play- 
back section information including playback 
start time information indicating a time to start 

50 playback of the video stream, playback end time 

information indicating a time to end playback of 
the video stream, and a stream number table, 
the stream number table indicates a playable 
audio stream that is recorded on one of the read- 

55 only optical disk and the supplementary record- 

ing medium, 

the predetermined procedure includes judging, 
for each of a plurality of audio streams indicated 
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in the stream number table, which of a plurality 
of conditions the audio stream satisfies, and se- 
lecting an audio stream according to a combi- 
nation of conditions judged to be satisfied, 
the plurality of conditions include a first condi- 5 
tion, a second condition, and a third condition, 
the first condition is that an audio stream has 
been judged to be playable, by comparing an 
encoding method of the audio stream with the 
configuration register, to 
the second condition is that a language attribute 
has been judged to match, by comparing a lan- 
guage code of the audio stream with the lan- 
guage setting register, 

the third condition is that surround output when is 
performing playback has been judged to be pos- 
sible, by comparing a channel structure of the 
audio stream with the configuration register, and 
if there is no audio stream that satisfies all of the 
first condition, the second condition, and the 20 
third condition, an audio stream among audio 
streams satisfying the first condition and the sec- 
ond condition is selected to which corresponds 
an entry in the stream number table at a place 
that indicates a first priority, and a stream 25 
number of the selected audio stream is set in 
the stream number register in the playback ap- 
paratus. 

2. The playback apparatus of claim 1 , wherein 30 
if there is no audio stream that satisfies all of the first 
condition, the second condition, and the third condi- 
tion, no audio stream that satisfies the first condition 
and the second condition, and no audio stream that 
satisfies the first condition and the third condition, an 35 
audio stream among audio streams satisfying the 
first condition is selected to which corresponds an 
entry in the stream number table at a place that in- 
dicates a first priority, and a stream number of the 
selected audio stream is set in the stream number 40 
register. 

3. The playback apparatus of claim 1 , wherein 

the read-only optical disk and the supplementary re- 
cording medium are recognized as virtual single disk 45 
by the playback apparatus; 

the playlist information includes stream file informa- 
tion that designates, with use of one of an identifying 
number indicating a stream file storing the audio 
stream on the read-only optical disk and an identify- so 
ing number indicating a stream file storing the audio 
data on the supplementary recording medium, one 
of the stream file storing the audio stream on the 
read-only optical disk and the stream file storing the 
audio data on the supplementary recording medium, 55 
in the stream number table, an audio stream that is 
judged to be playable is the audio stream designated 
by the stream file information in the playlist informa- 



tion, 

the stream number table indicates, for each audio 
stream, a reference value of a packet identifier in 
correspondence with a stream number, and 
the playback unit is further operable to perform read 
control to read, in accordance with the stream file 
information in the playlist information, one of a 
stream file on a read-only disk that stores an audio 
stream and a stream file on a supplementary record- 
ing medium that stores an audio stream, and 
the playback unit further comprises: 

a demultiplex unit operable, if a plurality of pack- 
ets included in an audio stream are read by the 
read control, to retrieve, from the stream number 
table, the reference value of the packet identifier 
corresponding to the stream number written in 
the stream number register, and to demultiplex 
packets in accordance with the reference value 
of the packet identifier, and 
an audio decoder operable to perform audio 
playback by decoding the packets obtained by 
the demultiplexing. 

4. The playback apparatus of claim 1 , wherein 

the audio stream at the place that indicates the first 
priority is an audio stream whose stream number is 
ranked top among the audio streams satisfying the 
first condition and the second condition, in the stream 
number table. 

5. The playback apparatus of claim 1 , wherein 

the playlist information includes subordinate play- 
back section information, 

the subordinate playback section information in- 
cludes playback start time information indicating a 
time to start playback of the video stream, playback 
end time information indicating a time to end play- 
back of the video stream, and synchronous time in- 
formation indicating a synchronous time on the time 
axis of the video stream, 

in the stream number table in the playback section 
information, an audio stream recorded on the sup- 
plementary recording medium that is permitted to be 
played back is the audio stream designated in the 
subordinate playback section information, 
the control unit executes the predetermined proce- 
dure upon playback section information of a section 
that is currently being played back switching to new 
playback section information, 
if the audio stream recorded on the supplementary 
recording medium is selected in the predetermined 
procedure, the playback unit plays back the audio 
stream in accordance with the subordinate playback 
section information, and 

playback in accordance with the subordinate play- 
back section information is performed by playing 
back a portion when a current playback time has 
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reached the synchronous time indicated in the syn- 
chronous time information on a time axis of a video 
stream, and from a position indicated in the playback 
start time information to a position indicated in the 
playback end time information of the subordinate 5 
playback section information in the audio stream. 

6. The playback apparatus of claim 1 , wherein 

the control unit executes the predetermined proce- 
dure if an operation requesting a change in the audio 10 
stream is performed by a user, and further charac- 
terized by comprising: 

a reception unit operable to receive a stream 
number X from a user, the stream number X 15 
being a number of a stream thatthe user desires 
to select; and 

the predetermined procedure includes judging 
whether the audio stream corresponding to the 
stream number received by the reception unit is 20 
playable with reference to a current stream 
number table, and if judged not to be playable, 
judging whether the stream number X is an in- 
definite value, and if judged not to be an indefi- 
nite value, maintaining a storage value of the 25 
stream number register, and if judged to be an 
indefinite value, performing processing to judge 
whether the first condition, second condition, 
and third condition have been satisfied, and se- 
lecting an audio stream as a replacement audio 30 
stream in accordance with a result of the judg- 
ment. 

7. A playback method for performing processing on a 
computer to play back a video stream and an audio 35 
stream in accordance with playlist information re- 
corded on a recording medium, the computer includ- 
ing a configuration register operable to indicate, for 
each encoding method, a configuration pertaining to 
whether surround audio can be output, a language 40 
setting register operable to indicate a language set- 
ting in the computer, and a stream number register 
operable to store a stream number of an audio 
stream to be played back, the playback method 
characterized by comprising the steps of: 45 

selecting one of the audio streams by executing 
a predetermined procedure, and 
playing back the selected audio stream along 
with the video stream, wherein 50 
the recording medium includes a read-only op- 
tical disk and a supplementary recording medi- 
um, 

the playlist information includes one or more 
pieces of playback section information, the play- 55 
back section information including playback 
start time information indicating a time to start 
playback of the video stream, playback end time 



information indicating a time to end playback of 
the video stream, and a stream number table, 
the stream number table indicates a playable 
audio stream that is recorded on one of the read- 
only optical disk and the supplementary record- 
ing medium, 

the predetermined procedure includes judging, 
for each of a plurality of audio streams indicated 
in the stream number table, which of a plurality 
of conditions the audio stream satisfies, and se- 
lecting an audio stream according to a combi- 
nation of conditions judged to be satisfied, 
the plurality of conditions include a first condi- 
tion, a second condition, and a third condition, 
the first condition is that an audio stream has 
been judged to be playable, by comparing an 
encoding method of the audio stream with the 
configuration register, 

the second condition is that a language attribute 
has been judged to match, by comparing a lan- 
guage code of the audio stream with the lan- 
guage setting register, 

the third condition is that surround output when 
performing playback has been judged to be pos- 
sible, by comparing a channel structure of the 
audio stream with the configuration register, and 
if there is no audio stream that satisfies all of the 
first condition, the second condition, and the 
third condition, an audio stream among audio 
streams satisfying the first condition and the sec- 
ond condition is selected to which corresponds 
an entry in the stream number table at a place 
that indicates a first priority and a stream number 
of the selected audio stream is set in the stream 
number register in the computer. 

8. A program for causing a computer to execute 
processing to play back a video stream and an audio 
stream in accordance with playlist information re- 
corded on a recording medium, the computer includ- 
ing a configuration register operable to indicate, for 
each encoding method, a configuration pertaining to 
whether surround audio can be output, a language 
setting register operable to indicate a language set- 
ting in the computer, and a stream number register 
operable to store a stream number of an audio 
stream to be played back, the program character- 
ized by comprising the steps of: 

selecting one of the audio streams by executing 
a predetermined procedure, and 
playing back the selected audio stream along 
with the video stream, wherein 
the recording medium includes a read-only op- 
tical disk and a supplementary recording medi- 
um, 

the playlist information includes one or more 
pieces of playback section information, the play- 



29 



57 EP 1 921 622 A2 58 

back section information including playback 
start time information indicating a time to start 
playback of the video stream, playback end time 
information indicating a time to end playback of 
the video stream, and a stream number table, 5 
the stream number table indicates a playable 
audio stream that is recorded on one of the read- 
only optical disk and the supplementary record- 
ing medium, 

the predetermined procedure includes judging, 10 
for each of a plurality of audio streams indicated 
in the stream number table, which of a plurality 
of conditions the audio stream satisfies, and se- 
lecting an audio stream according to a combi- 
nation of conditions judged to be satisfied, 15 
the plurality of conditions include a first condi- 
tion, a second condition, and a third condition, 
the first condition is that an audio stream has 
been judged to be playable, by comparing an 
encoding method of the audio stream with the 20 
configuration register, 

the second condition is that a language attribute 
has been judged to match, by comparing a lan- 
guage code of the audio stream with the lan- 
guage setting register, 25 
the third condition is that surround output when 
performing playback has been judged to be pos- 
sible, by comparing a channel structure of the 
audio stream with the configuration register, and 
if there is no audio stream that satisfies all of the 30 
first condition, the second condition, and the 
third condition, an audio stream among audio 
streams satisfying the first condition and the sec- 
ond condition is selected to which corresponds 
an entry in the stream number table at a place 35 
that indicates a first priority and a stream number 
of the selected audio stream is set in the stream 
number register in the computer. 
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